-- Logs begin at Thu 2022-08-18 18:36:04 UTC, end at Thu 2022-08-18 19:58:44 UTC. -- Aug 18 19:26:44.718817 dv-osbrick-786732-13-ceph systemd[1]: Starting Devstack devstack@keystone.service... Aug 18 19:26:44.727563 dv-osbrick-786732-13-ceph devstack@keystone.service[88459]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 18 19:26:44.730387 dv-osbrick-786732-13-ceph devstack@keystone.service[88459]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Aug 18 19:26:44 2022] *** Aug 18 19:26:44.730564 dv-osbrick-786732-13-ceph devstack@keystone.service[88459]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 18 19:26:44.730697 dv-osbrick-786732-13-ceph devstack@keystone.service[88459]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 18 19:26:44.730697 dv-osbrick-786732-13-ceph devstack@keystone.service[88459]: nodename: dv-osbrick-786732-13-ceph Aug 18 19:26:44.730697 dv-osbrick-786732-13-ceph devstack@keystone.service[88459]: machine: x86_64 Aug 18 19:26:44.730697 dv-osbrick-786732-13-ceph devstack@keystone.service[88459]: clock source: unix Aug 18 19:26:44.730697 dv-osbrick-786732-13-ceph devstack@keystone.service[88459]: pcre jit disabled Aug 18 19:26:44.730697 dv-osbrick-786732-13-ceph devstack@keystone.service[88459]: detected number of CPU cores: 4 Aug 18 19:26:44.730697 dv-osbrick-786732-13-ceph devstack@keystone.service[88459]: current working directory: / Aug 18 19:26:44.730697 dv-osbrick-786732-13-ceph devstack@keystone.service[88459]: detected binary path: /usr/bin/uwsgi-core Aug 18 19:26:44.730697 dv-osbrick-786732-13-ceph devstack@keystone.service[88459]: your processes number limit is 47680 Aug 18 19:26:44.730697 dv-osbrick-786732-13-ceph devstack@keystone.service[88459]: your memory page size is 4096 bytes Aug 18 19:26:44.730697 dv-osbrick-786732-13-ceph devstack@keystone.service[88459]: detected max file descriptor number: 2048 Aug 18 19:26:44.731282 dv-osbrick-786732-13-ceph devstack@keystone.service[88459]: lock engine: pthread robust mutexes Aug 18 19:26:44.731282 dv-osbrick-786732-13-ceph devstack@keystone.service[88459]: thunder lock: enabled Aug 18 19:26:44.731282 dv-osbrick-786732-13-ceph devstack@keystone.service[88459]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 18 19:26:44.731282 dv-osbrick-786732-13-ceph devstack@keystone.service[88459]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 18 19:26:44.776952 dv-osbrick-786732-13-ceph devstack@keystone.service[88459]: Python main interpreter initialized at 0x5556992579c0 Aug 18 19:26:44.776952 dv-osbrick-786732-13-ceph devstack@keystone.service[88459]: python threads support enabled Aug 18 19:26:44.776952 dv-osbrick-786732-13-ceph devstack@keystone.service[88459]: your server socket listen backlog is limited to 100 connections Aug 18 19:26:44.776952 dv-osbrick-786732-13-ceph devstack@keystone.service[88459]: your mercy for graceful operations on workers is 90 seconds Aug 18 19:26:44.781689 dv-osbrick-786732-13-ceph devstack@keystone.service[88459]: mapped 403077 bytes (393 KB) for 2 cores Aug 18 19:26:44.781689 dv-osbrick-786732-13-ceph devstack@keystone.service[88459]: *** Operational MODE: preforking *** Aug 18 19:26:44.781689 dv-osbrick-786732-13-ceph devstack@keystone.service[88459]: *** uWSGI is running in multiple interpreter mode *** Aug 18 19:26:44.781689 dv-osbrick-786732-13-ceph devstack@keystone.service[88459]: spawned uWSGI master process (pid: 88459) Aug 18 19:26:44.781689 dv-osbrick-786732-13-ceph devstack@keystone.service[88459]: spawned uWSGI worker 1 (pid: 88470, cores: 1) Aug 18 19:26:44.781689 dv-osbrick-786732-13-ceph devstack@keystone.service[88459]: spawned uWSGI worker 2 (pid: 88471, cores: 1) Aug 18 19:26:44.781689 dv-osbrick-786732-13-ceph devstack@keystone.service[88459]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 18 19:26:44.778130 dv-osbrick-786732-13-ceph systemd[1]: Started Devstack devstack@keystone.service. Aug 18 19:26:49.432822 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 19:26:49.432822 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: from cryptography.utils import int_from_bytes Aug 18 19:26:49.434133 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 19:26:49.434133 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: from cryptography.utils import int_from_bytes Aug 18 19:26:49.434285 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 19:26:49.434285 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: from cryptography.utils import int_from_bytes Aug 18 19:26:49.434285 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 19:26:49.434285 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: from cryptography.utils import int_from_bytes Aug 18 19:26:49.487392 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 18 19:26:49.487563 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 18 19:26:49.487656 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 18 19:26:49.487735 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 18 19:26:49.487801 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] command line args: [] {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 18 19:26:49.487865 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] command line args: [] {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 18 19:26:49.488040 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 18 19:26:49.488140 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 18 19:26:49.488219 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] ================================================================================ {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 18 19:26:49.488297 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] ================================================================================ {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 18 19:26:49.488458 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] admin_token = **** {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:26:49.488538 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] admin_token = **** {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:26:49.488703 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] config_dir = [] {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:26:49.488794 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] config_dir = [] {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:26:49.488893 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:26:49.488977 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:26:49.489054 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] config_source = [] {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:26:49.489123 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] config_source = [] {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:26:49.489238 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] debug = True {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:26:49.489330 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] debug = True {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:26:49.489437 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:26:49.489714 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:26:49.489815 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:26:49.489887 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:26:49.490014 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:26:49.490097 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:26:49.490242 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:26:49.490825 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:26:49.491027 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:26:49.491113 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:26:49.491264 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] list_limit = None {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:26:49.491341 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] list_limit = None {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:26:49.491445 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] log_config_append = None {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:26:49.491542 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] log_config_append = None {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:26:49.491643 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:26:49.491748 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:26:49.491856 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] log_dir = None {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:26:49.491958 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] log_dir = None {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:26:49.492053 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] log_file = None {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:26:49.492153 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] log_file = None {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:26:49.492153 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:26:49.492342 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:26:49.492416 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:26:49.492531 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:26:49.492632 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:26:49.492759 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:26:49.492880 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:26:49.492973 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:26:49.493092 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:26:49.493308 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:26:49.493439 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:26:49.493516 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:26:49.493641 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:26:49.493755 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:26:49.493875 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:26:49.493957 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:26:49.494030 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:26:49.494095 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:26:49.494172 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:26:49.494250 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:26:49.494366 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:26:49.494442 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:26:49.494600 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:26:49.494720 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:26:49.494850 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:26:49.494940 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:26:49.495095 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:26:49.495240 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:26:49.495371 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:26:49.495462 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:26:49.495867 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.23/identity {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:26:49.495951 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.23/identity {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:26:49.496049 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] publish_errors = False {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:26:49.496224 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] publish_errors = False {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:26:49.496303 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:26:49.496368 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:26:49.496497 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:26:49.496637 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:26:49.496719 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:26:49.496789 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:26:49.496912 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:26:49.497005 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:26:49.497148 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:26:49.497227 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:26:49.497378 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] standard_threads = False {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:26:49.497456 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] standard_threads = False {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:26:49.497609 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:26:49.497709 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:26:49.500620 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:26:49.500733 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:26:49.500855 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:26:49.500955 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:26:49.501057 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] use_journal = False {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:26:49.501161 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] use_journal = False {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:26:49.501266 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] use_json = False {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:26:49.501364 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] use_json = False {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:26:49.501459 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] use_stderr = False {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:26:49.501554 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] use_stderr = False {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:26:49.501683 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] use_syslog = False {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:26:49.501806 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] use_syslog = False {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:26:49.501893 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:26:49.501966 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 19:26:49.502036 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.502111 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.502188 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.502260 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.502405 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.502479 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.502548 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.502617 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.502734 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.502810 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.502889 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.502966 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.503042 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.503112 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.503187 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.503263 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.503341 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.503419 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.503490 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.503559 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.503627 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.503696 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.503772 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.503844 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.503918 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.503989 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.504067 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.504141 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.504221 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.504293 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.504368 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.504444 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.504521 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.504603 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.504676 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.504746 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.504868 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.504950 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.505072 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.505156 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.505233 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.505310 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.505381 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.505456 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.505531 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.505609 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.505697 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.505769 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.505838 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.505838 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.506005 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.506677 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.506763 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.506835 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.506905 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.506975 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.507044 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.507121 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.507193 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.507193 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.507317 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.507317 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.507441 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.507520 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.507592 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.507592 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.507715 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.507784 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.507909 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.507909 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.508056 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.508056 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.508235 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.508235 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.508362 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.508469 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.508548 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.508704 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.508779 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.508933 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.509015 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.509163 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.509246 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.509391 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.509499 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.509619 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.509720 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.509876 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.509961 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.510115 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.510202 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.510346 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.510435 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.510599 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.510679 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.510812 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.510895 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.511041 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.511127 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.511274 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.511363 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.511506 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.511586 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.511742 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.511824 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.511973 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.512058 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.512209 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.512287 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.512445 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.512522 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.512679 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.512764 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.512913 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.512996 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.513140 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.513218 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.513368 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.513452 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.513609 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.513752 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.513869 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.513952 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.514101 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.514180 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.514330 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.514415 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.514584 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.514662 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.514950 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.515047 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.515123 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.515200 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.515277 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.515347 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.515523 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.515673 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.515755 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.515827 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.515998 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.516083 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.516244 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.516332 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.516495 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.516580 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.516711 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.516789 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.516946 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.517097 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.517172 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.517243 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.517418 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.517496 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.517672 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.517766 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.517914 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.518039 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.518153 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.518230 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.518389 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.518475 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.518616 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.518697 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.518849 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.518973 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.519087 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.519218 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.519309 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.519485 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.519565 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.519733 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.519813 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.519981 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.520069 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.520225 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.520346 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.520473 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.520602 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.520716 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.520844 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.520959 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.521083 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.521199 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.521321 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.521433 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.521555 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.521729 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.521835 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.521969 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.522068 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.522209 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.522297 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.522442 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.522522 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.522687 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.522768 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.522925 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.523012 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.523178 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.523257 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.523418 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.523497 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.523673 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.523759 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.523935 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.524014 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.524175 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.524252 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.524404 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] auth.external = None {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.524489 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] auth.external = None {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.524632 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.524709 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.524937 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.525044 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.525175 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.525253 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.525381 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] auth.password = None {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.525467 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] auth.password = None {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.525608 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] auth.token = None {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.525740 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] auth.token = None {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.525873 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.525951 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.526107 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.526200 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.526351 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.526576 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.526667 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.526750 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.526831 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.527006 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.527087 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.527258 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.527337 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.527492 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] credential.caching = True {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.527572 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.527729 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] credential.caching = True {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.527808 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.527978 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.528063 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.528227 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.528315 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.528464 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.528542 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.528704 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.528782 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.528938 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.529024 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.529173 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.529259 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.529434 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.529512 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.529688 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.529785 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.529945 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.530024 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.530200 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.530280 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.530459 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.530544 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.530716 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.530795 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.530956 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.531034 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.531213 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.531365 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.531442 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] federation.caching = True {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.531512 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.531670 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.531750 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] federation.caching = True {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.531918 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.532005 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.532164 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.532249 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.532392 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.532471 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.532632 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.532718 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.532865 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.532943 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.533117 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.533210 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.533343 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.533430 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.533580 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.533689 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.533865 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.533982 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.534094 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.537914 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.537914 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] identity.caching = True {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.538155 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.538279 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.538404 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] identity.caching = True {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.538529 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.538663 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.538788 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.538913 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.539038 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.539162 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.539286 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.539417 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.539553 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.539678 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.539801 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.539926 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.540049 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.540181 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.540305 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.540428 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.540560 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.540683 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.540806 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.540939 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.541063 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.541186 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.541327 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.541452 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.541576 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.541776 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.541902 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.542032 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.542160 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.542288 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.542416 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.542552 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.542681 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.542809 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.542937 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.543076 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.543212 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.543340 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.543467 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.543595 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.543723 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.543851 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.543991 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.544126 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.544254 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.544379 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.544505 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.544640 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.544774 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.544915 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.545055 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.545189 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.545319 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.545442 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.545579 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.545721 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.545844 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.545973 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.546100 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.546228 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.546365 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.546494 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.546621 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.546757 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.546886 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.547014 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.547149 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.547277 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.547404 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.547530 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.547657 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.547784 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.547922 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.548049 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.548176 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.548304 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.548441 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.548567 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.548701 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.548834 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.548961 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.549093 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.549172 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.549246 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.549326 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.549400 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.549472 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.549543 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.549620 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.549740 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.549827 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.549908 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.549982 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.550054 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.550126 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.550198 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.550278 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.550352 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.550427 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] ldap.user = None {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.550500 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.550571 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.550643 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] ldap.user = None {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.550723 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.550797 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.550875 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.550949 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.551021 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.551093 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.551173 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.551247 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.551319 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.551390 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.551462 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.551533 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.551612 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.551686 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.551758 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.551836 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.551897 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.551956 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.552084 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.552163 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.552235 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.552306 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.552377 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.552449 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.552528 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.552602 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.552673 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.552745 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.552816 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.553497 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.553573 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.553662 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.553739 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.553811 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.553882 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.553953 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.554038 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.554114 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.554187 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.554259 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.554330 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.554410 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.554484 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.554556 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.554628 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.554699 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.554770 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.554849 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.554922 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.555000 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.555109 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.555174 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.555246 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.555315 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.555376 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.555434 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.555492 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.555551 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.555609 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.555738 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.555813 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.555874 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.555994 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.556071 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.556142 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.556142 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.556282 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.556355 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.556426 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.556498 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] resource.caching = True {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.556569 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.556648 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.556721 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.556792 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.556862 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] resource.caching = True {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.556933 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.557004 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.557083 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.557156 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.557226 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.557297 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.557367 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.557437 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.557515 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.557588 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.557685 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.557761 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.557843 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.557918 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.557997 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] role.caching = True {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.558070 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.558141 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] role.driver = sql {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.558212 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.558283 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.558354 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] role.caching = True {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.558480 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.558562 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] role.driver = sql {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.558730 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.558811 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.558983 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.559063 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.559229 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.559310 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.559475 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.559555 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.559720 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.559798 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.559963 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.560043 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.560206 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.560286 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.560435 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.560514 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.560683 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.560764 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.560911 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.560990 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.561160 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.561239 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.561404 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.561484 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.561668 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.561824 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.561943 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.566238 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.566238 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.566427 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.566427 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.566557 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.566629 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.566714 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.566789 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.566861 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.566861 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.566989 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.567060 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.567140 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.567140 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.567298 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.567381 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.567455 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.567455 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.567592 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.567666 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.567738 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.567798 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.567856 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.567923 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.567991 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.567991 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.568122 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.568193 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.568264 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.568264 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.568399 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.568514 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.568614 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.568689 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.568761 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.568821 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] token.caching = True {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.568900 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.568973 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.569045 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.569117 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.569189 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] token.caching = True {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.569257 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.569389 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.569468 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.569541 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.569600 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.569687 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.569751 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.569824 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.569921 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.570034 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.570150 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.570261 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.570372 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.570492 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.570603 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.570712 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.570818 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.570927 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.571033 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.571149 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.571257 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.571363 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.571473 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.571580 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.571685 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.571804 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.571913 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.572019 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.572125 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.572231 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.572335 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] database.connection = **** {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.572461 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.572590 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.572708 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.572823 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.572937 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] database.connection = **** {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.573065 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.573193 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.573311 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.573423 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.573533 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.573639 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.573775 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.573880 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.573987 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.574107 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.574215 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.574321 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.574427 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.574538 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.574649 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.574855 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.574968 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.575074 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.575182 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.575277 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.575384 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.575501 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.575701 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.575864 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.575975 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.576084 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.576194 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.576312 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.576422 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.576529 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.576637 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.576752 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.576861 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 18 19:26:49.576968 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.576968 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 19:26:49.576968 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 18 19:26:49.605507 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88470) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:26:49.605763 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88470) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:26:49.606001 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88470) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:26:49.607741 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88471) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:26:49.607976 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88471) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:26:49.608203 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88471) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:26:49.614803 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88470) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:26:49.617465 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88471) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:26:49.648933 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88471) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:26:49.649161 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88471) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:26:49.650501 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88470) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:26:49.650741 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88470) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:26:49.705381 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88471) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:26:49.705736 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88470) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:26:49.755563 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88471) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:26:49.755723 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88470) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:26:49.755797 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88471) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:26:49.755875 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88470) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:26:49.836315 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88471) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:26:49.836553 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88471) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:26:49.836694 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88470) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:26:49.836784 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88471) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:26:49.836862 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88470) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:26:49.836993 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88471) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:26:49.837098 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88470) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:26:49.837216 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88471) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:26:49.837300 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88470) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:26:49.837435 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88471) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:26:49.837518 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88470) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:26:49.837676 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88470) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:26:49.864130 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88471) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:26:49.864365 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88471) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:26:49.864598 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88471) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:26:49.864731 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88470) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:26:49.864831 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88471) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:26:49.864999 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88470) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:26:49.865084 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88471) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:26:49.865238 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88471) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:26:49.865347 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88470) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:26:49.866075 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88471) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:26:49.866218 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88470) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:26:49.866354 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88470) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:26:49.866484 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88470) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:26:49.866693 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88470) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:26:49.877299 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88471) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:26:49.877796 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88470) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:26:49.889794 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88471) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:26:49.890024 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88471) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:26:49.890252 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88471) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:26:49.890469 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88470) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:26:49.890615 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88471) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:26:49.890748 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88471) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:26:49.890873 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88470) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:26:49.891003 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88471) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:26:49.891133 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88470) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:26:49.891267 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88471) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:26:49.891397 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88470) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:26:49.891397 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88470) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:26:49.891635 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88470) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:26:49.891805 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88470) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 19:26:49.907822 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:49.913527 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 18 19:26:49.913626 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88470) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:49.913626 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88470) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 18 19:26:49.913842 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:49.913917 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88470) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:49.913917 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88470) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 18 19:26:49.914065 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 18 19:26:49.914137 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88470) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:49.914137 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88470) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:49.914264 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:49.914334 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88470) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:49.914403 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:49.914475 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88470) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:49.914546 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:49.914546 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:49.920260 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88470) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:49.920550 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88470) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:49.920832 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88470) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:49.921121 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88470) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:49.922551 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:49.922840 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:49.923121 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:49.923407 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:49.929394 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88470) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 19:26:49.931148 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88471) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 19:26:49.932499 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88470) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 19:26:49.932791 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88470) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:49.933082 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88470) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:49.933372 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88470) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:49.933673 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88470) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:49.933960 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88470) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:49.934121 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88471) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 19:26:49.934275 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88470) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:49.934449 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:49.934576 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88470) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:49.934704 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:49.934832 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88470) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:49.934959 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:49.935124 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88470) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:49.935253 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:49.935493 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88470) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:49.935617 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:49.935778 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:49.936060 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:49.936344 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:49.936614 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:49.936887 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:49.960500 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:49.960822 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88470) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:49.961947 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88471) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 19:26:49.962237 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:49.962320 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88470) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 19:26:49.962602 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88470) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:49.967073 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88471) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 19:26:49.967360 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:49.967453 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88470) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 19:26:49.967697 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88470) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:49.968097 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88470) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:49.969298 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:49.974552 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88470) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 19:26:49.975379 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88470) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:49.976320 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88471) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 19:26:49.976612 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:49.979523 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88470) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 19:26:49.979818 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88470) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:49.980112 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88470) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:49.980517 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88470) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:49.980642 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88471) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 19:26:49.980801 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88470) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:49.980927 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:49.981095 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88470) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:49.981221 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:49.981382 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88470) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:49.981537 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:49.981687 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88470) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:49.981832 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:49.982120 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:49.982396 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:49.982673 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:49.997548 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88470) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:49.997856 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88470) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:49.998557 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:49.998841 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:50.001809 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88470) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 19:26:50.002748 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88471) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 19:26:50.004915 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88470) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:50.005325 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88470) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:50.005893 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:50.006324 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:50.009783 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88470) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 19:26:50.010599 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88471) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 19:26:50.012952 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88470) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 19:26:50.013783 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88471) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 19:26:50.016079 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88470) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:50.016385 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88470) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:50.016680 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88470) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:50.016906 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:50.017076 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88470) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:50.017211 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:50.017474 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88470) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:50.017556 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:50.017812 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88470) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:50.017897 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:50.018192 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:50.018489 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:50.034323 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88470) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 19:26:50.034628 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88470) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:50.034905 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88470) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:50.035012 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88471) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 19:26:50.035185 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88470) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:50.035302 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:50.035574 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:50.035849 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:50.042657 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88470) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:50.043273 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:50.044332 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88470) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:50.044616 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88470) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:50.044921 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:50.045205 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:50.047316 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88470) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 19:26:50.047609 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88470) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:50.047897 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88470) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:50.047978 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88471) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 19:26:50.048187 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:50.048268 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88470) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:50.048467 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88470) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:50.048554 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:50.048755 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:50.049049 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:50.059896 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88470) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 19:26:50.060416 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88470) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:50.060505 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88470) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:50.060583 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88471) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 19:26:50.060724 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88470) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:50.060806 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:50.061015 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88470) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:50.061097 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:50.061298 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88470) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:50.061378 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:50.061592 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88470) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:50.061710 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:50.061906 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:50.062186 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:50.077184 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88470) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 19:26:50.077750 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88471) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 19:26:50.080151 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88470) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 19:26:50.080675 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88471) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 19:26:50.083185 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88470) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:50.083726 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:50.085154 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88470) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:50.085723 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:50.086663 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88470) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 19:26:50.086952 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88470) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:50.087225 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88471) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 19:26:50.087308 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88470) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:50.087521 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:50.087816 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:50.094030 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88470) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:50.094633 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:50.095506 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88470) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 19:26:50.096182 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88471) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 19:26:50.098448 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88470) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:50.098746 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88470) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:50.099038 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88470) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:50.099215 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:50.099341 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88470) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:50.099510 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:50.100414 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:50.100710 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:50.108726 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88471) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 19:26:50.108842 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88470) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 19:26:50.109025 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:50.109130 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88470) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:50.109309 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:50.109416 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88470) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:50.116191 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88471) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 19:26:50.116280 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88470) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 19:26:50.116651 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88470) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:50.116940 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88470) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:50.117244 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88470) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:50.117504 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:50.117586 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88470) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:50.117814 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88470) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:50.117908 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:50.118100 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:50.118179 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88470) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:50.118372 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88470) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:50.118451 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:50.118648 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88470) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:50.118736 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:50.118930 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88470) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:50.119012 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:50.119202 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:50.119280 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88470) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:50.119475 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88470) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:50.119554 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:50.119759 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88470) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:50.119838 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:50.120023 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88470) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:50.120150 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:50.120296 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:50.120585 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:50.120851 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 19:26:50.153460 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5556992579c0 pid: 88470 (default app) Aug 18 19:26:50.154482 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5556992579c0 pid: 88471 (default app) Aug 18 19:26:50.156900 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec22b4a-8e1f-46db-adf7-68033f61b078 None None] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:26:50.157194 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec22b4a-8e1f-46db-adf7-68033f61b078 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:26:50.157474 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec22b4a-8e1f-46db-adf7-68033f61b078 None None] PATH_INFO: `/v3` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:26:50.161579 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 1/1] 10.222.0.23 () {50 vars in 791 bytes} [Thu Aug 18 19:26:50 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:26:58.284781 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd964c5-0abb-417f-80eb-b6a885552a07 None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:26:58.285291 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd964c5-0abb-417f-80eb-b6a885552a07 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:26:58.285374 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd964c5-0abb-417f-80eb-b6a885552a07 None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:26:58.289607 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 1/2] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:26:58 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:26:58.294796 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f60be2-81f2-4399-8b3c-1d3926a6b965 None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:26:58.295219 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f60be2-81f2-4399-8b3c-1d3926a6b965 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:26:58.295337 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f60be2-81f2-4399-8b3c-1d3926a6b965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:26:58.383046 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: INFO dbcounter [None req-17f60be2-81f2-4399-8b3c-1d3926a6b965 None None] Registered counter for database keystone Aug 18 19:26:58.401972 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG oslo_db.sqlalchemy.engines [None req-17f60be2-81f2-4399-8b3c-1d3926a6b965 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88470) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 19:26:58.408141 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writer thread running {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 19:26:58.588542 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG passlib.handlers.bcrypt [None req-17f60be2-81f2-4399-8b3c-1d3926a6b965 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=88470) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 18 19:26:58.588968 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG passlib.handlers.bcrypt [None req-17f60be2-81f2-4399-8b3c-1d3926a6b965 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88470) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 18 19:26:58.645093 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-17f60be2-81f2-4399-8b3c-1d3926a6b965 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:26:58.646740 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-17f60be2-81f2-4399-8b3c-1d3926a6b965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:26:58.774099 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 2/3] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:26:58 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 480 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 18 19:26:59.322342 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd964c5-0abb-417f-80eb-b6a885552a07 None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:26:59.394386 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: INFO dbcounter [None req-efd964c5-0abb-417f-80eb-b6a885552a07 None None] Registered counter for database keystone Aug 18 19:26:59.416000 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG oslo_db.sqlalchemy.engines [None req-efd964c5-0abb-417f-80eb-b6a885552a07 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88471) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 19:26:59.422025 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writer thread running {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 19:26:59.539625 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd964c5-0abb-417f-80eb-b6a885552a07 None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:26:59.543866 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7febdd-168a-4d95-b9cd-e7e01705c398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df56ebe1a05047a7a4d05174a8a4c7f1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:26:59.544474 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7febdd-168a-4d95-b9cd-e7e01705c398 admin admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:26:59.544753 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7febdd-168a-4d95-b9cd-e7e01705c398 admin admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:26:59.545023 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7febdd-168a-4d95-b9cd-e7e01705c398 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:26:59.553011 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7febdd-168a-4d95-b9cd-e7e01705c398 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:26:59.606310 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: WARNING keystone.common.rbac_enforcer.enforcer [None req-2f7febdd-168a-4d95-b9cd-e7e01705c398 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 18 19:26:59.606495 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7febdd-168a-4d95-b9cd-e7e01705c398 admin admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:26:59.616535 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 2/4] 10.222.0.23 () {58 vars in 1324 bytes} [Thu Aug 18 19:26:59 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 19:26:59.623432 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f60be2-81f2-4399-8b3c-1d3926a6b965 None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:26:59.640556 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f60be2-81f2-4399-8b3c-1d3926a6b965 None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:26:59.645008 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc4d04f-eed4-4119-a0f7-290ced4d0022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df56ebe1a05047a7a4d05174a8a4c7f1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:26:59.647118 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc4d04f-eed4-4119-a0f7-290ced4d0022 admin admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:26:59.647118 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc4d04f-eed4-4119-a0f7-290ced4d0022 admin admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:26:59.647486 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc4d04f-eed4-4119-a0f7-290ced4d0022 admin admin] PATH_INFO: `/v3/projects/df56ebe1a05047a7a4d05174a8a4c7f1` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:26:59.648919 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc4d04f-eed4-4119-a0f7-290ced4d0022 admin admin] RBAC: Authorizing `identity:get_project(project_id=df56ebe1a05047a7a4d05174a8a4c7f1)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:26:59.700465 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: WARNING keystone.common.rbac_enforcer.enforcer [None req-2bc4d04f-eed4-4119-a0f7-290ced4d0022 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 18 19:26:59.700808 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc4d04f-eed4-4119-a0f7-290ced4d0022 admin admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:26:59.705492 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 3/5] 10.222.0.23 () {56 vars in 1207 bytes} [Thu Aug 18 19:26:59 2022] GET /identity/v3/projects/df56ebe1a05047a7a4d05174a8a4c7f1 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:27:01.820408 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd033b3-5faf-4fee-9ec3-a290a2313c42 None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:01.820948 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd033b3-5faf-4fee-9ec3-a290a2313c42 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:01.820948 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd033b3-5faf-4fee-9ec3-a290a2313c42 None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:01.825050 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 3/6] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:27:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:27:01.830495 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba7777b-81c1-4cac-a3c0-3e1ebb912b13 None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:01.830892 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba7777b-81c1-4cac-a3c0-3e1ebb912b13 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:01.831054 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba7777b-81c1-4cac-a3c0-3e1ebb912b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:01.851565 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-bba7777b-81c1-4cac-a3c0-3e1ebb912b13 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:27:01.853069 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-bba7777b-81c1-4cac-a3c0-3e1ebb912b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:27:01.860807 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 4/7] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:27:01 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 18 19:27:02.185675 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd033b3-5faf-4fee-9ec3-a290a2313c42 None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:02.198560 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd033b3-5faf-4fee-9ec3-a290a2313c42 None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:02.202850 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d26d2c-5f7d-4d35-b428-2c6b3837f242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df56ebe1a05047a7a4d05174a8a4c7f1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:02.203449 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d26d2c-5f7d-4d35-b428-2c6b3837f242 admin admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:02.203733 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d26d2c-5f7d-4d35-b428-2c6b3837f242 admin admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:02.204010 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d26d2c-5f7d-4d35-b428-2c6b3837f242 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:02.211623 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d26d2c-5f7d-4d35-b428-2c6b3837f242 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:02.213429 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d26d2c-5f7d-4d35-b428-2c6b3837f242 admin admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:02.222441 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 4/8] 10.222.0.23 () {58 vars in 1324 bytes} [Thu Aug 18 19:27:02 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 19:27:02.227729 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba7777b-81c1-4cac-a3c0-3e1ebb912b13 None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:02.236778 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba7777b-81c1-4cac-a3c0-3e1ebb912b13 None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:02.241712 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0500af73-c235-45e9-b12b-6ab7f8001dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df56ebe1a05047a7a4d05174a8a4c7f1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:02.242363 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0500af73-c235-45e9-b12b-6ab7f8001dc1 admin admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:02.242644 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0500af73-c235-45e9-b12b-6ab7f8001dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:02.242920 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0500af73-c235-45e9-b12b-6ab7f8001dc1 admin admin] PATH_INFO: `/v3/users/f765ddb0f75b40179001f4a64546ab53` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:02.244245 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0500af73-c235-45e9-b12b-6ab7f8001dc1 admin admin] RBAC: Authorizing `identity:get_user(user_id=f765ddb0f75b40179001f4a64546ab53)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:02.246096 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0500af73-c235-45e9-b12b-6ab7f8001dc1 admin admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:02.247595 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 5/9] 10.222.0.23 () {56 vars in 1198 bytes} [Thu Aug 18 19:27:02 2022] GET /identity/v3/users/f765ddb0f75b40179001f4a64546ab53 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:27:04.471179 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab7698-7106-418c-bab4-69a026695760 None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:04.471697 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab7698-7106-418c-bab4-69a026695760 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:04.471796 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab7698-7106-418c-bab4-69a026695760 None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:04.473032 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 5/10] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:27:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:27:04.478924 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a971202-eae6-4a02-ad8c-2c9721424209 None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:04.479325 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a971202-eae6-4a02-ad8c-2c9721424209 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:04.479497 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a971202-eae6-4a02-ad8c-2c9721424209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:04.497084 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-8a971202-eae6-4a02-ad8c-2c9721424209 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:27:04.498262 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-8a971202-eae6-4a02-ad8c-2c9721424209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:27:04.543247 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f47a17-b56d-4f5a-a7f3-9f5dac1efe5b None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:04.543526 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f47a17-b56d-4f5a-a7f3-9f5dac1efe5b None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:04.543801 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f47a17-b56d-4f5a-a7f3-9f5dac1efe5b None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:04.545102 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 6/11] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:27:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:27:04.550577 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afffc33-cbc3-4087-998f-dafae1d582ef None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:04.550855 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afffc33-cbc3-4087-998f-dafae1d582ef None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:04.551126 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afffc33-cbc3-4087-998f-dafae1d582ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:04.595930 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG passlib.handlers.bcrypt [None req-6afffc33-cbc3-4087-998f-dafae1d582ef None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=88471) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 18 19:27:04.596351 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG passlib.handlers.bcrypt [None req-6afffc33-cbc3-4087-998f-dafae1d582ef None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88471) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 18 19:27:04.642191 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-6afffc33-cbc3-4087-998f-dafae1d582ef None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:27:04.643825 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-6afffc33-cbc3-4087-998f-dafae1d582ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:27:04.689267 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 6/12] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:27:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:27:04.745043 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 7/13] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:27:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 19:27:05.020230 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a971202-eae6-4a02-ad8c-2c9721424209 None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:05.045324 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:05.062715 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afffc33-cbc3-4087-998f-dafae1d582ef None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:05.129456 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a971202-eae6-4a02-ad8c-2c9721424209 None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:05.162738 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47b8caa-0a77-4c06-b81b-7e9b3268ef7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:05.163369 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47b8caa-0a77-4c06-b81b-7e9b3268ef7f None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:05.163651 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47b8caa-0a77-4c06-b81b-7e9b3268ef7f None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:05.163929 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47b8caa-0a77-4c06-b81b-7e9b3268ef7f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:05.165813 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afffc33-cbc3-4087-998f-dafae1d582ef None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:05.168091 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:05.175298 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47b8caa-0a77-4c06-b81b-7e9b3268ef7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:27:05.184228 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application [None req-a47b8caa-0a77-4c06-b81b-7e9b3268ef7f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 19:27:05.184228 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:27:05.184228 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:27:05.184228 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:27:05.184228 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:27:05.184228 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:27:05.184228 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:27:05.184228 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:27:05.184228 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:27:05.184228 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:27:05.184228 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:27:05.184228 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:27:05.184228 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:27:05.184228 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:27:05.184228 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:27:05.184228 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:27:05.185277 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:27:05.185277 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:27:05.185277 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:27:05.185277 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:27:05.185277 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:27:05.185277 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:27:05.185277 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:27:05.185277 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:27:05.185277 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:27:05.185277 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:27:05.185277 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:27:05.185277 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application with Lock( Aug 18 19:27:05.185277 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:27:05.185277 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:27:05.185277 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:27:05.185277 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:27:05.192972 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:27:05.192972 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:27:05.192972 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:27:05.192972 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:27:05.192972 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:27:05.192972 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:27:05.192972 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:27:05.192972 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:27:05.192972 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:27:05.192972 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:27:05.192972 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 19:27:05.192972 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:27:05.192972 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 7/14] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Aug 18 19:27:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:27:05.192972 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47b8caa-0a77-4c06-b81b-7e9b3268ef7f None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:05.204840 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7bbeb7-8518-43ba-aac9-be2c1e7b99de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:05.205378 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7bbeb7-8518-43ba-aac9-be2c1e7b99de None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:05.205700 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7bbeb7-8518-43ba-aac9-be2c1e7b99de None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:05.205971 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7bbeb7-8518-43ba-aac9-be2c1e7b99de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:05.273851 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:05.275376 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7bbeb7-8518-43ba-aac9-be2c1e7b99de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:05.276930 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7bbeb7-8518-43ba-aac9-be2c1e7b99de None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:05.291673 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47b8caa-0a77-4c06-b81b-7e9b3268ef7f None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:05.326798 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62809b6f-4faf-4a1e-99b0-26ee4b3684b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:05.327404 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62809b6f-4faf-4a1e-99b0-26ee4b3684b8 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:05.327684 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62809b6f-4faf-4a1e-99b0-26ee4b3684b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:05.327959 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62809b6f-4faf-4a1e-99b0-26ee4b3684b8 None admin] PATH_INFO: `/v3/roles` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:05.328657 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62809b6f-4faf-4a1e-99b0-26ee4b3684b8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:27:05.328934 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62809b6f-4faf-4a1e-99b0-26ee4b3684b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:05.330381 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62809b6f-4faf-4a1e-99b0-26ee4b3684b8 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:05.342404 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 8/15] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Aug 18 19:27:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:27:05.348126 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62809b6f-4faf-4a1e-99b0-26ee4b3684b8 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:05.380628 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 8/16] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Aug 18 19:27:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 18 19:27:05.386156 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7bbeb7-8518-43ba-aac9-be2c1e7b99de None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:05.388873 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:05.447207 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62809b6f-4faf-4a1e-99b0-26ee4b3684b8 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:05.481403 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec0e9dd-0588-4ae3-98d5-ab10fb3a9460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:05.482079 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec0e9dd-0588-4ae3-98d5-ab10fb3a9460 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:05.482329 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec0e9dd-0588-4ae3-98d5-ab10fb3a9460 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:05.482658 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec0e9dd-0588-4ae3-98d5-ab10fb3a9460 None admin] PATH_INFO: `/v3/users/f765ddb0f75b40179001f4a64546ab53` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:05.483814 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec0e9dd-0588-4ae3-98d5-ab10fb3a9460 None admin] RBAC: Authorizing `identity:get_user(user_id=f765ddb0f75b40179001f4a64546ab53)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:05.484608 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7bbeb7-8518-43ba-aac9-be2c1e7b99de None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:05.485298 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec0e9dd-0588-4ae3-98d5-ab10fb3a9460 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:05.487369 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 9/17] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Aug 18 19:27:05 2022] GET /identity/v3/users/f765ddb0f75b40179001f4a64546ab53 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:27:05.492917 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec0e9dd-0588-4ae3-98d5-ab10fb3a9460 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:05.508730 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:05.518966 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183f7a23-8c87-441e-8b4a-74a9dc8c2fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:05.519825 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f7a23-8c87-441e-8b4a-74a9dc8c2fd8 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:05.520105 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f7a23-8c87-441e-8b4a-74a9dc8c2fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:05.528555 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f7a23-8c87-441e-8b4a-74a9dc8c2fd8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:05.539125 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183f7a23-8c87-441e-8b4a-74a9dc8c2fd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:05.540589 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183f7a23-8c87-441e-8b4a-74a9dc8c2fd8 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:05.558780 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application [None req-183f7a23-8c87-441e-8b4a-74a9dc8c2fd8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:27:05.558780 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:27:05.558780 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:27:05.558780 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:27:05.558780 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:27:05.558780 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:27:05.558780 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:27:05.558780 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:27:05.558780 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:27:05.558780 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:27:05.558780 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:27:05.558780 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:27:05.558780 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 19:27:05.558780 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 19:27:05.558780 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 19:27:05.558780 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 19:27:05.559772 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:27:05.559772 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:27:05.559772 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:27:05.559772 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:27:05.559772 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:27:05.559772 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:27:05.559772 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:27:05.559772 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application with Lock( Aug 18 19:27:05.559772 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:27:05.559772 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:27:05.559772 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:27:05.559772 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:27:05.559772 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:27:05.559772 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:27:05.559772 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:27:05.559772 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:27:05.559772 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 19:27:05.560567 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 19:27:05.560567 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:27:05.560567 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:27:05.560567 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 9/18] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Aug 18 19:27:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 19:27:05.565530 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183f7a23-8c87-441e-8b4a-74a9dc8c2fd8 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:05.594198 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec0e9dd-0588-4ae3-98d5-ab10fb3a9460 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:05.621961 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:05.628327 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f7236-b1b3-4248-b5eb-c174d6e8047d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:05.628956 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f7236-b1b3-4248-b5eb-c174d6e8047d None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:05.634345 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f7236-b1b3-4248-b5eb-c174d6e8047d None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:05.634345 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f7236-b1b3-4248-b5eb-c174d6e8047d None admin] PATH_INFO: `/v3/domains/default` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:05.634345 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05f7236-b1b3-4248-b5eb-c174d6e8047d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:05.634345 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05f7236-b1b3-4248-b5eb-c174d6e8047d None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:05.634345 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 10/19] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Aug 18 19:27:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:27:05.639408 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f7236-b1b3-4248-b5eb-c174d6e8047d None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:05.726276 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:05.745598 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f7236-b1b3-4248-b5eb-c174d6e8047d None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:05.776219 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183f7a23-8c87-441e-8b4a-74a9dc8c2fd8 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:05.780117 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693eea44-83a6-48fc-b8fc-8526c505a5d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:05.780663 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693eea44-83a6-48fc-b8fc-8526c505a5d8 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:05.780938 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693eea44-83a6-48fc-b8fc-8526c505a5d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:05.781211 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693eea44-83a6-48fc-b8fc-8526c505a5d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:05.781963 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693eea44-83a6-48fc-b8fc-8526c505a5d8 None admin] RBAC: Adding query filter params (role.id=33fe6be3baf44b969c8166af5142e0c7, scope.domain.id=default, user.id=f765ddb0f75b40179001f4a64546ab53) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:27:05.782268 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693eea44-83a6-48fc-b8fc-8526c505a5d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:05.783690 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693eea44-83a6-48fc-b8fc-8526c505a5d8 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:05.790867 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 11/20] 10.222.0.23 () {56 vars in 1322 bytes} [Thu Aug 18 19:27:05 2022] GET /identity/v3/role_assignments?user.id=f765ddb0f75b40179001f4a64546ab53&scope.domain.id=default&role.id=33fe6be3baf44b969c8166af5142e0c7 => generated 233 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:27:05.811299 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e475d27-3f72-4ee2-8205-737e42f02940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:05.811925 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e475d27-3f72-4ee2-8205-737e42f02940 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:05.812206 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e475d27-3f72-4ee2-8205-737e42f02940 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:05.812479 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e475d27-3f72-4ee2-8205-737e42f02940 None admin] PATH_INFO: `/v3/domains` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:05.813142 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e475d27-3f72-4ee2-8205-737e42f02940 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:27:05.813449 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e475d27-3f72-4ee2-8205-737e42f02940 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:05.814938 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e475d27-3f72-4ee2-8205-737e42f02940 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:05.834995 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 10/21] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Aug 18 19:27:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:27:08.191616 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3cde54-69ea-4a46-896d-95eeded84500 None None] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:08.192676 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3cde54-69ea-4a46-896d-95eeded84500 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:08.192774 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3cde54-69ea-4a46-896d-95eeded84500 None None] PATH_INFO: `/` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:08.194149 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 12/22] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:27:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:27:08.199513 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe42ad-67b6-4e74-99da-c45cb956819f None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:08.199928 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe42ad-67b6-4e74-99da-c45cb956819f None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:08.200098 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe42ad-67b6-4e74-99da-c45cb956819f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:08.238690 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-e0fe42ad-67b6-4e74-99da-c45cb956819f None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:27:08.240824 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-e0fe42ad-67b6-4e74-99da-c45cb956819f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:27:08.378617 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 11/23] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:27:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:27:08.539437 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601838e0-d18a-4fa6-8b65-2602246d4f6f None None] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:08.540103 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601838e0-d18a-4fa6-8b65-2602246d4f6f None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:08.540593 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601838e0-d18a-4fa6-8b65-2602246d4f6f None None] PATH_INFO: `/` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:08.542494 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 13/24] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:27:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:27:08.547318 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb3bd79-8390-444e-95c9-90d59c320578 None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:08.547608 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb3bd79-8390-444e-95c9-90d59c320578 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:08.547888 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb3bd79-8390-444e-95c9-90d59c320578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:08.571477 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-afb3bd79-8390-444e-95c9-90d59c320578 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:27:08.572695 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-afb3bd79-8390-444e-95c9-90d59c320578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:27:08.626438 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:08.657810 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 12/25] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:27:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:27:08.830774 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601838e0-d18a-4fa6-8b65-2602246d4f6f None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:08.971116 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601838e0-d18a-4fa6-8b65-2602246d4f6f None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:09.023731 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86693fd4-52d3-4337-b495-90c6afd3d680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:09.024767 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86693fd4-52d3-4337-b495-90c6afd3d680 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:09.025247 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86693fd4-52d3-4337-b495-90c6afd3d680 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:09.025739 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86693fd4-52d3-4337-b495-90c6afd3d680 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:09.042125 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86693fd4-52d3-4337-b495-90c6afd3d680 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:27:09.046992 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application [None req-86693fd4-52d3-4337-b495-90c6afd3d680 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 19:27:09.046992 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:27:09.046992 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:27:09.046992 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:27:09.046992 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:27:09.046992 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:27:09.046992 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:27:09.046992 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:27:09.046992 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:27:09.046992 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:27:09.046992 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:27:09.046992 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:27:09.046992 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:27:09.046992 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:27:09.046992 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:27:09.046992 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:27:09.047836 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:27:09.047836 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:27:09.047836 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:27:09.047836 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:27:09.047836 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:27:09.047836 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:27:09.047836 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:27:09.047836 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:27:09.047836 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:27:09.047836 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:27:09.047836 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:27:09.047836 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application with Lock( Aug 18 19:27:09.047836 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:27:09.047836 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:27:09.047836 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:27:09.047836 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:27:09.048588 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:27:09.048588 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:27:09.048588 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:27:09.048588 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:27:09.048588 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:27:09.048588 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:27:09.048588 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:27:09.048588 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:27:09.048588 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:27:09.048588 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:27:09.048588 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 19:27:09.048588 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:27:09.048588 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 14/26] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Aug 18 19:27:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:27:09.054079 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb3bd79-8390-444e-95c9-90d59c320578 None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:09.125729 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af94f4fc-e0f0-4ad5-9de7-282e63208a46 None None] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:09.126269 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af94f4fc-e0f0-4ad5-9de7-282e63208a46 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:09.126960 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af94f4fc-e0f0-4ad5-9de7-282e63208a46 None None] PATH_INFO: `/` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:09.131315 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 15/27] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:27:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:27:09.136723 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf968b1-4455-4230-8569-1e91a4c81f76 None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:09.137201 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf968b1-4455-4230-8569-1e91a4c81f76 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:09.137689 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf968b1-4455-4230-8569-1e91a4c81f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:09.150005 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:09.170744 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-0bf968b1-4455-4230-8569-1e91a4c81f76 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:27:09.172164 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-0bf968b1-4455-4230-8569-1e91a4c81f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:27:09.236987 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb3bd79-8390-444e-95c9-90d59c320578 None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:09.252597 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 16/28] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:27:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 19:27:09.253963 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f438c9a2-f003-438d-a363-37a123787fc4 None None] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:09.254257 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f438c9a2-f003-438d-a363-37a123787fc4 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:09.255076 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f438c9a2-f003-438d-a363-37a123787fc4 None None] PATH_INFO: `/` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:09.256864 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 17/29] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:27:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:27:09.262447 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45f9ce-b22a-4396-825e-03a9d715531a None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:09.262738 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45f9ce-b22a-4396-825e-03a9d715531a None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:09.263020 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45f9ce-b22a-4396-825e-03a9d715531a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:09.283809 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-6e45f9ce-b22a-4396-825e-03a9d715531a None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:27:09.285001 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-6e45f9ce-b22a-4396-825e-03a9d715531a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:27:09.327219 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb740fbc-796d-4288-a6fd-a87a342e5cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:09.327835 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb740fbc-796d-4288-a6fd-a87a342e5cf0 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:09.328115 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb740fbc-796d-4288-a6fd-a87a342e5cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:09.328380 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb740fbc-796d-4288-a6fd-a87a342e5cf0 None admin] PATH_INFO: `/v3/roles` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:09.329041 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb740fbc-796d-4288-a6fd-a87a342e5cf0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:27:09.329339 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb740fbc-796d-4288-a6fd-a87a342e5cf0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:09.330744 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb740fbc-796d-4288-a6fd-a87a342e5cf0 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:09.352780 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 13/30] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Aug 18 19:27:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:27:09.353695 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb740fbc-796d-4288-a6fd-a87a342e5cf0 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:09.363818 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 18/31] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:27:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:27:09.364585 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e45f9ce-b22a-4396-825e-03a9d715531a None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:09.432402 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:09.470750 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:09.505278 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb740fbc-796d-4288-a6fd-a87a342e5cf0 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:09.544125 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8f98be-a774-422b-956d-7f6d248be87f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:09.545114 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8f98be-a774-422b-956d-7f6d248be87f None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:09.545608 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8f98be-a774-422b-956d-7f6d248be87f None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:09.546207 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8f98be-a774-422b-956d-7f6d248be87f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:09.558443 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8f98be-a774-422b-956d-7f6d248be87f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:09.559760 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e45f9ce-b22a-4396-825e-03a9d715531a None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:09.560431 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8f98be-a774-422b-956d-7f6d248be87f None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:09.576981 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application [None req-1e8f98be-a774-422b-956d-7f6d248be87f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:27:09.576981 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:27:09.576981 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:27:09.576981 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:27:09.576981 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:27:09.576981 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:27:09.576981 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:27:09.576981 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:27:09.576981 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:27:09.576981 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:27:09.576981 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:27:09.576981 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:27:09.576981 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 19:27:09.576981 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 19:27:09.576981 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 19:27:09.576981 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 19:27:09.577887 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:27:09.577887 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:27:09.577887 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:27:09.577887 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:27:09.577887 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:27:09.577887 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:27:09.577887 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:27:09.577887 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application with Lock( Aug 18 19:27:09.577887 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:27:09.577887 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:27:09.577887 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:27:09.577887 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:27:09.577887 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:27:09.577887 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:27:09.577887 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:27:09.577887 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:27:09.577887 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 19:27:09.578685 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 19:27:09.578685 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:27:09.578685 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:27:09.580503 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 14/32] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Aug 18 19:27:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:27:09.590952 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8f98be-a774-422b-956d-7f6d248be87f None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:09.678359 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dd6983-781a-4f84-b019-51ce2a175b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:09.679000 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd6983-781a-4f84-b019-51ce2a175b55 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:09.679271 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd6983-781a-4f84-b019-51ce2a175b55 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:09.679540 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd6983-781a-4f84-b019-51ce2a175b55 None admin] PATH_INFO: `/v3/users/f765ddb0f75b40179001f4a64546ab53` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:09.680691 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dd6983-781a-4f84-b019-51ce2a175b55 None admin] RBAC: Authorizing `identity:get_user(user_id=f765ddb0f75b40179001f4a64546ab53)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:09.682180 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dd6983-781a-4f84-b019-51ce2a175b55 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:09.683759 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 19/33] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Aug 18 19:27:09 2022] GET /identity/v3/users/f765ddb0f75b40179001f4a64546ab53 => generated 247 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:27:09.689236 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dd6983-781a-4f84-b019-51ce2a175b55 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:09.715495 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:09.739250 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8f98be-a774-422b-956d-7f6d248be87f None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:09.794969 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13dd851-7c4b-403d-b2a4-04ce06de0170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:09.795909 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13dd851-7c4b-403d-b2a4-04ce06de0170 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:09.796390 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13dd851-7c4b-403d-b2a4-04ce06de0170 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:09.796858 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13dd851-7c4b-403d-b2a4-04ce06de0170 None admin] PATH_INFO: `/v3/domains` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:09.797804 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13dd851-7c4b-403d-b2a4-04ce06de0170 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:27:09.798359 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13dd851-7c4b-403d-b2a4-04ce06de0170 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:09.800060 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13dd851-7c4b-403d-b2a4-04ce06de0170 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:09.814109 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 15/34] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Aug 18 19:27:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:27:09.815351 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13dd851-7c4b-403d-b2a4-04ce06de0170 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:09.861040 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dd6983-781a-4f84-b019-51ce2a175b55 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:09.899914 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:09.905543 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4413b5bf-ef1b-44f5-975c-cc1822303d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:09.906206 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4413b5bf-ef1b-44f5-975c-cc1822303d7d None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:09.906484 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4413b5bf-ef1b-44f5-975c-cc1822303d7d None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:09.906756 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4413b5bf-ef1b-44f5-975c-cc1822303d7d None admin] PATH_INFO: `/v3/domains/default` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:09.908015 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4413b5bf-ef1b-44f5-975c-cc1822303d7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:09.910211 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4413b5bf-ef1b-44f5-975c-cc1822303d7d None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:09.912483 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 20/35] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Aug 18 19:27:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:27:09.913538 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4413b5bf-ef1b-44f5-975c-cc1822303d7d None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:09.931860 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13dd851-7c4b-403d-b2a4-04ce06de0170 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:09.972834 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23a9034-1dac-44e0-90c0-e696092d3b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:09.974378 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23a9034-1dac-44e0-90c0-e696092d3b8b None admin] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:09.974954 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23a9034-1dac-44e0-90c0-e696092d3b8b None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:09.975437 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23a9034-1dac-44e0-90c0-e696092d3b8b None admin] PATH_INFO: `/v3/roles` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:09.976267 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23a9034-1dac-44e0-90c0-e696092d3b8b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:09.977969 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23a9034-1dac-44e0-90c0-e696092d3b8b None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:10.026895 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4413b5bf-ef1b-44f5-975c-cc1822303d7d None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:10.072556 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2b8307-a0e3-4727-b13b-66133bb23b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:10.073245 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b8307-a0e3-4727-b13b-66133bb23b3f None admin] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:10.073508 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b8307-a0e3-4727-b13b-66133bb23b3f None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:10.073955 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b8307-a0e3-4727-b13b-66133bb23b3f None admin] PATH_INFO: `/v3/roles` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:10.074650 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2b8307-a0e3-4727-b13b-66133bb23b3f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:10.076066 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2b8307-a0e3-4727-b13b-66133bb23b3f None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:10.252394 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 16/36] 10.222.0.23 () {60 vars in 1131 bytes} [Thu Aug 18 19:27:09 2022] POST /identity/v3/roles => generated 225 bytes in 437 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 19:27:10.253348 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23a9034-1dac-44e0-90c0-e696092d3b8b None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:10.277240 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:10.378845 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23a9034-1dac-44e0-90c0-e696092d3b8b None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:10.420654 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f33c0f7-b351-4ade-a9b1-b7f3480eaadd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:10.421766 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f33c0f7-b351-4ade-a9b1-b7f3480eaadd None admin] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:10.422281 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f33c0f7-b351-4ade-a9b1-b7f3480eaadd None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:10.422753 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f33c0f7-b351-4ade-a9b1-b7f3480eaadd None admin] PATH_INFO: `/v3/projects` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:10.424017 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f33c0f7-b351-4ade-a9b1-b7f3480eaadd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:10.426075 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f33c0f7-b351-4ade-a9b1-b7f3480eaadd None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:10.437753 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 21/37] 10.222.0.23 () {60 vars in 1131 bytes} [Thu Aug 18 19:27:09 2022] POST /identity/v3/roles => generated 219 bytes in 525 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 19:27:10.446901 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2b8307-a0e3-4727-b13b-66133bb23b3f None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:10.539479 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:10.543348 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 17/38] 10.222.0.23 () {60 vars in 1141 bytes} [Thu Aug 18 19:27:10 2022] POST /identity/v3/projects => generated 301 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 19:27:10.545101 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa14617e-5656-4b8c-b0b2-feda5fc93fb7 None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:10.545429 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa14617e-5656-4b8c-b0b2-feda5fc93fb7 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:10.546560 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa14617e-5656-4b8c-b0b2-feda5fc93fb7 None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:10.548057 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 18/39] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:27:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:27:10.554172 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e0247-ee64-44af-8ce2-8d1a72bf1029 None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:10.554514 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e0247-ee64-44af-8ce2-8d1a72bf1029 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:10.554802 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e0247-ee64-44af-8ce2-8d1a72bf1029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:10.591970 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-983e0247-ee64-44af-8ce2-8d1a72bf1029 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:27:10.597491 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-983e0247-ee64-44af-8ce2-8d1a72bf1029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:27:10.619824 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2b8307-a0e3-4727-b13b-66133bb23b3f None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:10.662923 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d19464-2a28-4579-a7ab-972770344337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:10.663856 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d19464-2a28-4579-a7ab-972770344337 None admin] REQUEST_METHOD: `PUT` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:10.664278 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d19464-2a28-4579-a7ab-972770344337 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:10.664738 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d19464-2a28-4579-a7ab-972770344337 None admin] PATH_INFO: `/v3/domains/default/users/f765ddb0f75b40179001f4a64546ab53/roles/33fe6be3baf44b969c8166af5142e0c7` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:10.667196 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d19464-2a28-4579-a7ab-972770344337 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=f765ddb0f75b40179001f4a64546ab53, role_id=33fe6be3baf44b969c8166af5142e0c7)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:10.669082 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d19464-2a28-4579-a7ab-972770344337 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:10.680464 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:10.691462 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 19/40] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:27:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:27:10.693638 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d0ee24-2fe2-454b-843e-7af8cb15a3c9 None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:10.693966 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d0ee24-2fe2-454b-843e-7af8cb15a3c9 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:10.694247 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d0ee24-2fe2-454b-843e-7af8cb15a3c9 None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:10.695712 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 20/41] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:27:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:27:10.701417 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6083463-7219-49f5-9dc6-c8aa28e5a9ce None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:10.701764 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6083463-7219-49f5-9dc6-c8aa28e5a9ce None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:10.702046 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6083463-7219-49f5-9dc6-c8aa28e5a9ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:10.722724 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-a6083463-7219-49f5-9dc6-c8aa28e5a9ce None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:27:10.724065 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-a6083463-7219-49f5-9dc6-c8aa28e5a9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:27:10.758129 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 22/42] 10.222.0.23 () {58 vars in 1361 bytes} [Thu Aug 18 19:27:10 2022] PUT /identity/v3/domains/default/users/f765ddb0f75b40179001f4a64546ab53/roles/33fe6be3baf44b969c8166af5142e0c7 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 19:27:10.807205 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 21/43] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:27:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 19:27:11.025286 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d19464-2a28-4579-a7ab-972770344337 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:11.136705 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d19464-2a28-4579-a7ab-972770344337 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:11.139509 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6083463-7219-49f5-9dc6-c8aa28e5a9ce None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:11.157450 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:11.171750 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5174e7be-bba9-4240-913d-ae8c200b3fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:11.172360 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5174e7be-bba9-4240-913d-ae8c200b3fa8 None admin] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:11.172640 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5174e7be-bba9-4240-913d-ae8c200b3fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:11.172925 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5174e7be-bba9-4240-913d-ae8c200b3fa8 None admin] PATH_INFO: `/v3/roles` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:11.173611 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5174e7be-bba9-4240-913d-ae8c200b3fa8 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:11.175033 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5174e7be-bba9-4240-913d-ae8c200b3fa8 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:11.231336 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 23/44] 10.222.0.23 () {60 vars in 1131 bytes} [Thu Aug 18 19:27:11 2022] POST /identity/v3/roles => generated 223 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 19:27:11.246130 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6083463-7219-49f5-9dc6-c8aa28e5a9ce None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:11.273377 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:11.287485 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223a0f47-c23c-4bfe-bf6c-9ce711bfc86c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:11.288111 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223a0f47-c23c-4bfe-bf6c-9ce711bfc86c None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:11.288403 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223a0f47-c23c-4bfe-bf6c-9ce711bfc86c None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:11.288668 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223a0f47-c23c-4bfe-bf6c-9ce711bfc86c None admin] PATH_INFO: `/v3/domains/default` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:11.289931 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223a0f47-c23c-4bfe-bf6c-9ce711bfc86c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:11.291449 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223a0f47-c23c-4bfe-bf6c-9ce711bfc86c None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:11.293329 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 22/45] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Aug 18 19:27:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:27:11.299479 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5174e7be-bba9-4240-913d-ae8c200b3fa8 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:11.416991 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5174e7be-bba9-4240-913d-ae8c200b3fa8 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:11.453942 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0e19ed-be93-418d-9ef1-2ca5933e6929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:11.454685 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0e19ed-be93-418d-9ef1-2ca5933e6929 None admin] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:11.454850 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0e19ed-be93-418d-9ef1-2ca5933e6929 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:11.455106 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0e19ed-be93-418d-9ef1-2ca5933e6929 None admin] PATH_INFO: `/v3/projects` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:11.455751 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0e19ed-be93-418d-9ef1-2ca5933e6929 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:11.457265 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0e19ed-be93-418d-9ef1-2ca5933e6929 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:11.557480 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 24/46] 10.222.0.23 () {60 vars in 1141 bytes} [Thu Aug 18 19:27:11 2022] POST /identity/v3/projects => generated 312 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 19:27:12.933702 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292dd101-5488-4b16-8339-6d453fd95c59 None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:12.934213 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292dd101-5488-4b16-8339-6d453fd95c59 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:12.934293 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292dd101-5488-4b16-8339-6d453fd95c59 None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:12.935608 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 23/47] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:27:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:27:12.940802 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29f5b1-65aa-49d1-813d-ad86dfae66c7 None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:12.941209 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29f5b1-65aa-49d1-813d-ad86dfae66c7 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:12.941376 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29f5b1-65aa-49d1-813d-ad86dfae66c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:12.960207 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-fc29f5b1-65aa-49d1-813d-ad86dfae66c7 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:27:12.961715 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-fc29f5b1-65aa-49d1-813d-ad86dfae66c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:27:12.986656 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:13.027192 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 25/48] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:27:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:27:13.355581 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292dd101-5488-4b16-8339-6d453fd95c59 None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:13.456844 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292dd101-5488-4b16-8339-6d453fd95c59 None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:13.490436 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e17c32-d5bd-43a0-99e9-c3f3982da684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:13.491059 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e17c32-d5bd-43a0-99e9-c3f3982da684 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:13.491341 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e17c32-d5bd-43a0-99e9-c3f3982da684 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:13.491619 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e17c32-d5bd-43a0-99e9-c3f3982da684 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:13.502683 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e17c32-d5bd-43a0-99e9-c3f3982da684 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:27:13.510277 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application [None req-98e17c32-d5bd-43a0-99e9-c3f3982da684 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 19:27:13.510277 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:27:13.510277 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:27:13.510277 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:27:13.510277 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:27:13.510277 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:27:13.510277 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:27:13.510277 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:27:13.510277 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:27:13.510277 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:27:13.510277 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:27:13.510277 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:27:13.510277 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:27:13.510277 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:27:13.510277 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:27:13.510277 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:27:13.511121 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:27:13.511121 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:27:13.511121 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:27:13.511121 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:27:13.511121 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:27:13.511121 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:27:13.511121 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:27:13.511121 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:27:13.511121 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:27:13.511121 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:27:13.511121 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:27:13.511121 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application with Lock( Aug 18 19:27:13.511121 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:27:13.511121 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:27:13.511121 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:27:13.511121 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:27:13.511864 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:27:13.511864 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:27:13.511864 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:27:13.511864 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:27:13.511864 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:27:13.511864 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:27:13.511864 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:27:13.511864 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:27:13.511864 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:27:13.511864 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:27:13.511864 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 19:27:13.511864 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:27:13.511864 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 24/49] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Aug 18 19:27:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:27:13.517469 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc29f5b1-65aa-49d1-813d-ad86dfae66c7 None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:13.618736 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc29f5b1-65aa-49d1-813d-ad86dfae66c7 None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:13.650704 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c980b350-e137-4743-9623-b06062750cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:13.651309 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c980b350-e137-4743-9623-b06062750cf9 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:13.651588 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c980b350-e137-4743-9623-b06062750cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:13.651859 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c980b350-e137-4743-9623-b06062750cf9 None admin] PATH_INFO: `/v3/roles` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:13.652515 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c980b350-e137-4743-9623-b06062750cf9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:27:13.652813 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c980b350-e137-4743-9623-b06062750cf9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:13.654241 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c980b350-e137-4743-9623-b06062750cf9 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:13.662644 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 26/50] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Aug 18 19:27:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:27:13.668352 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e17c32-d5bd-43a0-99e9-c3f3982da684 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:13.717596 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:13.728690 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15268e1e-763b-4dab-a38d-581ee200c35a None None] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:13.728976 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15268e1e-763b-4dab-a38d-581ee200c35a None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:13.729261 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15268e1e-763b-4dab-a38d-581ee200c35a None None] PATH_INFO: `/` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:13.730653 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 27/51] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:27:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 19:27:13.735441 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaeee90-fce9-4364-9334-9caf44cb4f8b None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:13.735727 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaeee90-fce9-4364-9334-9caf44cb4f8b None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:13.736006 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaeee90-fce9-4364-9334-9caf44cb4f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:13.754167 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-2eaeee90-fce9-4364-9334-9caf44cb4f8b None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:27:13.755637 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-2eaeee90-fce9-4364-9334-9caf44cb4f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:27:13.767648 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e17c32-d5bd-43a0-99e9-c3f3982da684 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:13.772734 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:13.800669 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5147f970-3799-43e6-9aba-53e08718c546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:13.801949 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5147f970-3799-43e6-9aba-53e08718c546 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:13.802228 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5147f970-3799-43e6-9aba-53e08718c546 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:13.802502 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5147f970-3799-43e6-9aba-53e08718c546 None admin] PATH_INFO: `/v3/users/f765ddb0f75b40179001f4a64546ab53` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:13.803856 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5147f970-3799-43e6-9aba-53e08718c546 None admin] RBAC: Authorizing `identity:get_user(user_id=f765ddb0f75b40179001f4a64546ab53)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:13.805299 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5147f970-3799-43e6-9aba-53e08718c546 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:13.806944 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 25/52] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Aug 18 19:27:13 2022] GET /identity/v3/users/f765ddb0f75b40179001f4a64546ab53 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:27:13.812256 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5147f970-3799-43e6-9aba-53e08718c546 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:13.823641 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 28/53] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:27:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 19:27:13.912669 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5147f970-3799-43e6-9aba-53e08718c546 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:13.929658 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:13.946208 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fed2055-d1bb-4e7b-9fb2-a620dbcd208b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:13.946845 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed2055-d1bb-4e7b-9fb2-a620dbcd208b None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:13.947131 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed2055-d1bb-4e7b-9fb2-a620dbcd208b None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:13.947410 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed2055-d1bb-4e7b-9fb2-a620dbcd208b None admin] PATH_INFO: `/v3/domains/default` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:13.948528 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fed2055-d1bb-4e7b-9fb2-a620dbcd208b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:13.950068 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fed2055-d1bb-4e7b-9fb2-a620dbcd208b None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:13.951626 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 26/54] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Aug 18 19:27:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:27:13.958004 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaeee90-fce9-4364-9334-9caf44cb4f8b None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:14.057160 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaeee90-fce9-4364-9334-9caf44cb4f8b None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:14.094230 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a35d659-9d9d-4357-9cd7-fe893e0f36ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:14.094830 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a35d659-9d9d-4357-9cd7-fe893e0f36ea None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:14.095109 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a35d659-9d9d-4357-9cd7-fe893e0f36ea None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:14.095379 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a35d659-9d9d-4357-9cd7-fe893e0f36ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:14.096094 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a35d659-9d9d-4357-9cd7-fe893e0f36ea None admin] RBAC: Adding query filter params (role.id=33fe6be3baf44b969c8166af5142e0c7, scope.domain.id=default, user.id=f765ddb0f75b40179001f4a64546ab53) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:27:14.096399 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a35d659-9d9d-4357-9cd7-fe893e0f36ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:14.098394 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a35d659-9d9d-4357-9cd7-fe893e0f36ea None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:14.104165 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 29/55] 10.222.0.23 () {56 vars in 1322 bytes} [Thu Aug 18 19:27:13 2022] GET /identity/v3/role_assignments?user.id=f765ddb0f75b40179001f4a64546ab53&scope.domain.id=default&role.id=33fe6be3baf44b969c8166af5142e0c7 => generated 530 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:27:14.148521 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fed2055-d1bb-4e7b-9fb2-a620dbcd208b None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:14.254071 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fed2055-d1bb-4e7b-9fb2-a620dbcd208b None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:14.289291 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8989f50-f271-4e01-931c-290dbae0fc67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:14.289966 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8989f50-f271-4e01-931c-290dbae0fc67 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:14.290260 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8989f50-f271-4e01-931c-290dbae0fc67 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:14.290532 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8989f50-f271-4e01-931c-290dbae0fc67 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:14.291649 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8989f50-f271-4e01-931c-290dbae0fc67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:14.293105 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8989f50-f271-4e01-931c-290dbae0fc67 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:14.294704 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 27/56] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Aug 18 19:27:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:27:14.300274 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a35d659-9d9d-4357-9cd7-fe893e0f36ea None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:14.320490 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:14.400190 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a35d659-9d9d-4357-9cd7-fe893e0f36ea None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:14.435213 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1dd87b-12e1-47f1-8ab8-aab4ccbf3800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:14.435825 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1dd87b-12e1-47f1-8ab8-aab4ccbf3800 None admin] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:14.436110 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1dd87b-12e1-47f1-8ab8-aab4ccbf3800 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:14.436385 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1dd87b-12e1-47f1-8ab8-aab4ccbf3800 None admin] PATH_INFO: `/v3/projects` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:14.437037 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1dd87b-12e1-47f1-8ab8-aab4ccbf3800 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:14.438528 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1dd87b-12e1-47f1-8ab8-aab4ccbf3800 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:14.522618 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 30/57] 10.222.0.23 () {60 vars in 1140 bytes} [Thu Aug 18 19:27:14 2022] POST /identity/v3/projects => generated 298 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 19:27:16.669326 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e18cd0-989d-4539-bbb5-dd887f9a6a97 None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:16.669855 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e18cd0-989d-4539-bbb5-dd887f9a6a97 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:16.669937 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e18cd0-989d-4539-bbb5-dd887f9a6a97 None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:16.671234 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 28/58] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:27:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:27:16.677009 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb5f1e3-895a-40b5-82b6-a1df9d7a2361 None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:16.677417 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb5f1e3-895a-40b5-82b6-a1df9d7a2361 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:16.677564 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb5f1e3-895a-40b5-82b6-a1df9d7a2361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:16.695267 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-9eb5f1e3-895a-40b5-82b6-a1df9d7a2361 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:27:16.696450 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-9eb5f1e3-895a-40b5-82b6-a1df9d7a2361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:27:16.757308 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:16.761554 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 31/59] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:27:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:27:17.084184 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e18cd0-989d-4539-bbb5-dd887f9a6a97 None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:17.140064 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:17.183487 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e18cd0-989d-4539-bbb5-dd887f9a6a97 None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:17.216545 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18fb9ff-bbb6-49c5-8837-60bf9a8e26e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:17.217155 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18fb9ff-bbb6-49c5-8837-60bf9a8e26e9 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:17.217432 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18fb9ff-bbb6-49c5-8837-60bf9a8e26e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:17.217726 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18fb9ff-bbb6-49c5-8837-60bf9a8e26e9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:17.219143 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18fb9ff-bbb6-49c5-8837-60bf9a8e26e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:17.220584 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18fb9ff-bbb6-49c5-8837-60bf9a8e26e9 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:17.222144 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 29/60] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Aug 18 19:27:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:27:17.227604 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb5f1e3-895a-40b5-82b6-a1df9d7a2361 None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:17.324366 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb5f1e3-895a-40b5-82b6-a1df9d7a2361 None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:17.357230 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cef67a-e9a5-4534-b9b4-6eddbf5a3d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:17.357863 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cef67a-e9a5-4534-b9b4-6eddbf5a3d70 None admin] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:17.358144 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cef67a-e9a5-4534-b9b4-6eddbf5a3d70 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:17.358418 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cef67a-e9a5-4534-b9b4-6eddbf5a3d70 None admin] PATH_INFO: `/v3/users` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:17.359060 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cef67a-e9a5-4534-b9b4-6eddbf5a3d70 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:17.360543 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cef67a-e9a5-4534-b9b4-6eddbf5a3d70 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:17.458195 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 32/61] 10.222.0.23 () {60 vars in 1132 bytes} [Thu Aug 18 19:27:17 2022] POST /identity/v3/users => generated 275 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 19:27:20.762171 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7833329e-2812-4874-9257-e0f380e46fe4 None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:20.762713 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7833329e-2812-4874-9257-e0f380e46fe4 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:20.762713 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7833329e-2812-4874-9257-e0f380e46fe4 None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:20.764056 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 30/62] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:27:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:27:20.770683 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13c9f29-11dd-4036-be51-d47940e5f15f None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:20.771189 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13c9f29-11dd-4036-be51-d47940e5f15f None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:20.771293 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13c9f29-11dd-4036-be51-d47940e5f15f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:20.798865 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-f13c9f29-11dd-4036-be51-d47940e5f15f None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:27:20.800103 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-f13c9f29-11dd-4036-be51-d47940e5f15f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:27:20.866850 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:20.888149 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 33/63] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:27:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:27:20.964164 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c23ce0-1d35-4e4d-aac9-cf0cad0bbc4f None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:20.964712 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c23ce0-1d35-4e4d-aac9-cf0cad0bbc4f None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:20.964994 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c23ce0-1d35-4e4d-aac9-cf0cad0bbc4f None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:20.966642 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 31/64] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:27:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:27:20.978853 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a409373c-08a0-4838-a53d-6c37c7fcd142 None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:20.979189 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a409373c-08a0-4838-a53d-6c37c7fcd142 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:20.979419 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a409373c-08a0-4838-a53d-6c37c7fcd142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:21.003513 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-a409373c-08a0-4838-a53d-6c37c7fcd142 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:27:21.004711 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-a409373c-08a0-4838-a53d-6c37c7fcd142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:27:21.100803 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 34/65] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:27:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:27:21.198620 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1f271-249c-4f4d-8829-9cc9e135208a None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:21.198901 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1f271-249c-4f4d-8829-9cc9e135208a None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:21.199334 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1f271-249c-4f4d-8829-9cc9e135208a None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:21.200808 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 32/66] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:27:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:27:21.206255 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1948fb0-8d52-428a-ad00-f930f7d1ab1f None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:21.207171 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1948fb0-8d52-428a-ad00-f930f7d1ab1f None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:21.207452 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1948fb0-8d52-428a-ad00-f930f7d1ab1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:21.230206 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-f1948fb0-8d52-428a-ad00-f930f7d1ab1f None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:27:21.231382 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-f1948fb0-8d52-428a-ad00-f930f7d1ab1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:27:21.244520 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d1f271-249c-4f4d-8829-9cc9e135208a None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:21.346582 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 35/67] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:27:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:27:21.427324 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d1f271-249c-4f4d-8829-9cc9e135208a None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:21.450547 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b513b0-6c1b-4aa2-84f7-c14c8289f35e None None] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:21.451048 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b513b0-6c1b-4aa2-84f7-c14c8289f35e None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:21.451467 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b513b0-6c1b-4aa2-84f7-c14c8289f35e None None] PATH_INFO: `/` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:21.453460 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 36/68] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:27:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:27:21.458392 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c57ed04-2faa-4b3e-933f-2744fdbfb8ad None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:21.458933 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c57ed04-2faa-4b3e-933f-2744fdbfb8ad None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:21.459402 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c57ed04-2faa-4b3e-933f-2744fdbfb8ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:21.473112 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:21.481095 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bb2307-9102-4033-98cf-db253c15f9ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:21.481756 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb2307-9102-4033-98cf-db253c15f9ef None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:21.482037 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb2307-9102-4033-98cf-db253c15f9ef None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:21.482318 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb2307-9102-4033-98cf-db253c15f9ef None admin] PATH_INFO: `/v3/roles/member` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:21.486888 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-1c57ed04-2faa-4b3e-933f-2744fdbfb8ad None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:27:21.488875 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-1c57ed04-2faa-4b3e-933f-2744fdbfb8ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:27:21.507400 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bb2307-9102-4033-98cf-db253c15f9ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:27:21.512461 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application [None req-a1bb2307-9102-4033-98cf-db253c15f9ef None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 19:27:21.512461 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:27:21.512461 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:27:21.512461 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:27:21.512461 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:27:21.512461 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:27:21.512461 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:27:21.512461 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:27:21.512461 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:27:21.512461 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:27:21.512461 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:27:21.512461 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:27:21.512461 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:27:21.512461 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:27:21.512461 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:27:21.512461 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:27:21.513290 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:27:21.513290 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:27:21.513290 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:27:21.513290 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:27:21.513290 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:27:21.513290 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:27:21.513290 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:27:21.513290 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:27:21.513290 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:27:21.513290 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:27:21.513290 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:27:21.513290 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application with Lock( Aug 18 19:27:21.513290 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:27:21.513290 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:27:21.513290 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:27:21.513290 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:27:21.514067 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:27:21.514067 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:27:21.514067 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:27:21.514067 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:27:21.514067 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:27:21.514067 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:27:21.514067 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:27:21.514067 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:27:21.514067 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:27:21.514067 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:27:21.514067 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 19:27:21.514067 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:27:21.522717 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 33/69] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Aug 18 19:27:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 19:27:21.527941 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bb2307-9102-4033-98cf-db253c15f9ef None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:21.566642 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:21.592181 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 37/70] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:27:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 19:27:21.593535 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bcfff7-c9be-4ce9-8023-6c8c797c02fa None None] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:21.593857 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bcfff7-c9be-4ce9-8023-6c8c797c02fa None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:21.594142 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bcfff7-c9be-4ce9-8023-6c8c797c02fa None None] PATH_INFO: `/` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:21.595495 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 38/71] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:27:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:27:21.598522 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bcfff7-c9be-4ce9-8023-6c8c797c02fa None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:21.662744 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bb2307-9102-4033-98cf-db253c15f9ef None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:21.700869 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36967c9-d992-4460-b806-995cbf276c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:21.701722 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36967c9-d992-4460-b806-995cbf276c3a None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:21.702143 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36967c9-d992-4460-b806-995cbf276c3a None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:21.702642 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36967c9-d992-4460-b806-995cbf276c3a None admin] PATH_INFO: `/v3/roles` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:21.703506 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36967c9-d992-4460-b806-995cbf276c3a None admin] RBAC: Adding query filter params (name=member) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:27:21.704003 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36967c9-d992-4460-b806-995cbf276c3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:21.705569 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36967c9-d992-4460-b806-995cbf276c3a None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:21.714214 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 34/72] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Aug 18 19:27:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:27:21.715869 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6453d9ab-32fc-41b3-838a-92d92b9d4f8a None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:21.716293 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6453d9ab-32fc-41b3-838a-92d92b9d4f8a None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:21.716691 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6453d9ab-32fc-41b3-838a-92d92b9d4f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:21.734878 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-6453d9ab-32fc-41b3-838a-92d92b9d4f8a None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:27:21.735940 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bcfff7-c9be-4ce9-8023-6c8c797c02fa None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:21.736504 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-6453d9ab-32fc-41b3-838a-92d92b9d4f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:27:21.773676 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe34f432-4fa5-48f5-a35a-6e04e54e0949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:21.774394 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe34f432-4fa5-48f5-a35a-6e04e54e0949 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:21.774672 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe34f432-4fa5-48f5-a35a-6e04e54e0949 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:21.774944 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe34f432-4fa5-48f5-a35a-6e04e54e0949 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:21.780558 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:21.786297 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe34f432-4fa5-48f5-a35a-6e04e54e0949 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:27:21.791103 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application [None req-fe34f432-4fa5-48f5-a35a-6e04e54e0949 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 19:27:21.791103 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:27:21.791103 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:27:21.791103 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:27:21.791103 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:27:21.791103 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:27:21.791103 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:27:21.791103 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:27:21.791103 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:27:21.791103 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:27:21.791103 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:27:21.791103 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:27:21.791103 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:27:21.791103 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:27:21.791103 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:27:21.791103 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:27:21.797067 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:27:21.797067 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:27:21.797067 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:27:21.797067 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:27:21.797067 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:27:21.797067 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:27:21.797067 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:27:21.797067 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:27:21.797067 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:27:21.797067 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:27:21.797067 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:27:21.797067 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application with Lock( Aug 18 19:27:21.797067 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:27:21.797067 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:27:21.797067 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:27:21.797067 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:27:21.797943 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:27:21.797943 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:27:21.797943 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:27:21.797943 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:27:21.797943 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:27:21.797943 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:27:21.797943 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:27:21.797943 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:27:21.797943 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:27:21.797943 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:27:21.797943 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 19:27:21.797943 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:27:21.797943 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 39/73] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Aug 18 19:27:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:27:21.797943 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe34f432-4fa5-48f5-a35a-6e04e54e0949 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:21.809831 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 35/74] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:27:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:27:21.817835 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6453d9ab-32fc-41b3-838a-92d92b9d4f8a None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:21.842809 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:21.915964 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe34f432-4fa5-48f5-a35a-6e04e54e0949 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:21.933173 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6453d9ab-32fc-41b3-838a-92d92b9d4f8a None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:21.952765 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0239378d-902e-49a2-ba9d-44cca41eb87c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:21.953399 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0239378d-902e-49a2-ba9d-44cca41eb87c None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:21.953699 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0239378d-902e-49a2-ba9d-44cca41eb87c None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:21.953978 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0239378d-902e-49a2-ba9d-44cca41eb87c None admin] PATH_INFO: `/v3/users/10bd00684b524d61b436781e07111a43` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:21.968561 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0239378d-902e-49a2-ba9d-44cca41eb87c None admin] RBAC: Authorizing `identity:get_user(user_id=10bd00684b524d61b436781e07111a43)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:21.970064 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0239378d-902e-49a2-ba9d-44cca41eb87c None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:21.971412 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d0ea84-e846-4c4c-a837-e0f7ac17f343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:21.971991 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 40/75] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Aug 18 19:27:21 2022] GET /identity/v3/users/10bd00684b524d61b436781e07111a43 => generated 275 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:27:21.972627 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d0ea84-e846-4c4c-a837-e0f7ac17f343 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:21.972852 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d0ea84-e846-4c4c-a837-e0f7ac17f343 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:21.973154 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0239378d-902e-49a2-ba9d-44cca41eb87c None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:21.973261 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d0ea84-e846-4c4c-a837-e0f7ac17f343 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:21.984258 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d0ea84-e846-4c4c-a837-e0f7ac17f343 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:27:21.989527 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application [None req-06d0ea84-e846-4c4c-a837-e0f7ac17f343 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 19:27:21.989527 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:27:21.989527 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:27:21.989527 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:27:21.989527 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:27:21.989527 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:27:21.989527 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:27:21.989527 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:27:21.989527 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:27:21.989527 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:27:21.989527 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:27:21.989527 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:27:21.989527 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:27:21.989527 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:27:21.989527 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:27:21.989527 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:27:21.990388 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:27:21.990388 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:27:21.990388 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:27:21.990388 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:27:21.990388 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:27:21.990388 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:27:21.990388 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:27:21.990388 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:27:21.990388 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:27:21.990388 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:27:21.990388 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:27:21.990388 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application with Lock( Aug 18 19:27:21.990388 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:27:21.990388 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:27:21.990388 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:27:21.990388 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:27:21.991179 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:27:21.991179 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:27:21.991179 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:27:21.991179 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:27:21.991179 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:27:21.991179 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:27:21.991179 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:27:21.991179 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:27:21.991179 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:27:21.991179 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:27:21.991179 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 19:27:21.991179 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:27:21.991179 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 36/76] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Aug 18 19:27:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:27:21.991808 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d0ea84-e846-4c4c-a837-e0f7ac17f343 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:22.033051 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:22.074996 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:22.081519 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0239378d-902e-49a2-ba9d-44cca41eb87c None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:22.114311 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d0ea84-e846-4c4c-a837-e0f7ac17f343 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:22.117300 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73b5ab6-aa37-4a63-b170-2b77b8e14cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:22.118129 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73b5ab6-aa37-4a63-b170-2b77b8e14cee None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:22.118410 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73b5ab6-aa37-4a63-b170-2b77b8e14cee None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:22.118684 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73b5ab6-aa37-4a63-b170-2b77b8e14cee None admin] PATH_INFO: `/v3/roles` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:22.119352 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73b5ab6-aa37-4a63-b170-2b77b8e14cee None admin] RBAC: Adding query filter params (name=admin) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:27:22.119658 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73b5ab6-aa37-4a63-b170-2b77b8e14cee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:22.121038 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73b5ab6-aa37-4a63-b170-2b77b8e14cee None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:22.133500 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 41/77] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Aug 18 19:27:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:27:22.133500 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73b5ab6-aa37-4a63-b170-2b77b8e14cee None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:22.156285 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e5c6e3-8270-4527-a990-f7b729c9de6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:22.156912 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e5c6e3-8270-4527-a990-f7b729c9de6d None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:22.157191 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e5c6e3-8270-4527-a990-f7b729c9de6d None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:22.157497 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e5c6e3-8270-4527-a990-f7b729c9de6d None admin] PATH_INFO: `/v3/domains/default` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:22.158635 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e5c6e3-8270-4527-a990-f7b729c9de6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:22.160631 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e5c6e3-8270-4527-a990-f7b729c9de6d None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:22.162214 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 37/78] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Aug 18 19:27:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:27:22.162962 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e5c6e3-8270-4527-a990-f7b729c9de6d None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:22.231797 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73b5ab6-aa37-4a63-b170-2b77b8e14cee None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:22.260568 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e5c6e3-8270-4527-a990-f7b729c9de6d None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:22.262200 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:22.263732 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe7df15-b7f8-443c-acfa-1ddc76f54d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:22.264344 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe7df15-b7f8-443c-acfa-1ddc76f54d92 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:22.264633 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe7df15-b7f8-443c-acfa-1ddc76f54d92 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:22.264906 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe7df15-b7f8-443c-acfa-1ddc76f54d92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:22.289723 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:22.294653 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75061c9-a975-4e77-9590-6311ec20bfa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:22.295255 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75061c9-a975-4e77-9590-6311ec20bfa0 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:22.295613 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75061c9-a975-4e77-9590-6311ec20bfa0 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:22.295838 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75061c9-a975-4e77-9590-6311ec20bfa0 None admin] PATH_INFO: `/v3/roles` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:22.296891 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75061c9-a975-4e77-9590-6311ec20bfa0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:27:22.297423 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75061c9-a975-4e77-9590-6311ec20bfa0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:22.299437 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75061c9-a975-4e77-9590-6311ec20bfa0 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:22.307544 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 38/79] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Aug 18 19:27:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:27:22.308161 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75061c9-a975-4e77-9590-6311ec20bfa0 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:22.333389 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe7df15-b7f8-443c-acfa-1ddc76f54d92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:22.335021 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe7df15-b7f8-443c-acfa-1ddc76f54d92 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:22.409261 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75061c9-a975-4e77-9590-6311ec20bfa0 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:22.432542 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 42/80] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Aug 18 19:27:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 19:27:22.432542 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe7df15-b7f8-443c-acfa-1ddc76f54d92 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:22.442779 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8eacb7-913a-4475-ad15-06416a32f6de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:22.443406 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8eacb7-913a-4475-ad15-06416a32f6de None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:22.443686 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8eacb7-913a-4475-ad15-06416a32f6de None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:22.443996 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8eacb7-913a-4475-ad15-06416a32f6de None admin] PATH_INFO: `/v3/users/f765ddb0f75b40179001f4a64546ab53` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:22.445130 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8eacb7-913a-4475-ad15-06416a32f6de None admin] RBAC: Authorizing `identity:get_user(user_id=f765ddb0f75b40179001f4a64546ab53)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:22.446580 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8eacb7-913a-4475-ad15-06416a32f6de None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:22.448154 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 39/81] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Aug 18 19:27:22 2022] GET /identity/v3/users/f765ddb0f75b40179001f4a64546ab53 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:27:22.448884 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8eacb7-913a-4475-ad15-06416a32f6de None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:22.487831 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:22.495619 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:22.538935 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe7df15-b7f8-443c-acfa-1ddc76f54d92 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:22.559388 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8eacb7-913a-4475-ad15-06416a32f6de None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:22.574176 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869e2d73-1766-4d31-b045-8017938cfa1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:22.574831 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e2d73-1766-4d31-b045-8017938cfa1a None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:22.575113 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e2d73-1766-4d31-b045-8017938cfa1a None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:22.575389 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e2d73-1766-4d31-b045-8017938cfa1a None admin] PATH_INFO: `/v3/roles/member` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:22.586120 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869e2d73-1766-4d31-b045-8017938cfa1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:27:22.591509 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application [None req-869e2d73-1766-4d31-b045-8017938cfa1a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 19:27:22.591509 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:27:22.591509 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:27:22.591509 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:27:22.591509 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:27:22.591509 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:27:22.591509 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:27:22.591509 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:27:22.591509 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:27:22.591509 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:27:22.591509 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:27:22.591509 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:27:22.591509 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:27:22.591509 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:27:22.591509 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:27:22.591509 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:27:22.592356 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:27:22.592356 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:27:22.592356 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:27:22.592356 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:27:22.592356 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:27:22.592356 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:27:22.592356 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:27:22.592356 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:27:22.592356 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:27:22.592356 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:27:22.592356 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:27:22.592356 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application with Lock( Aug 18 19:27:22.592356 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:27:22.592356 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:27:22.592356 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:27:22.592356 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:27:22.593093 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:27:22.593093 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:27:22.593093 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:27:22.593093 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:27:22.593093 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:27:22.593093 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:27:22.593093 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:27:22.593093 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:27:22.593093 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:27:22.593093 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:27:22.593093 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 19:27:22.593093 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:27:22.593093 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 43/82] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Aug 18 19:27:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:27:22.593755 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869e2d73-1766-4d31-b045-8017938cfa1a None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:22.598955 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f6257b-4694-44aa-942d-70e2488f330a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:22.599574 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f6257b-4694-44aa-942d-70e2488f330a None admin] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:22.599856 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f6257b-4694-44aa-942d-70e2488f330a None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:22.600130 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f6257b-4694-44aa-942d-70e2488f330a None admin] PATH_INFO: `/v3/users` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:22.600780 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f6257b-4694-44aa-942d-70e2488f330a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:22.602272 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f6257b-4694-44aa-942d-70e2488f330a None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:22.686012 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 40/83] 10.222.0.23 () {60 vars in 1132 bytes} [Thu Aug 18 19:27:22 2022] POST /identity/v3/users => generated 289 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 19:27:22.686985 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f6257b-4694-44aa-942d-70e2488f330a None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:22.691263 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869e2d73-1766-4d31-b045-8017938cfa1a None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:22.712437 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:22.736124 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a740938f-5812-4f46-bfe8-486a6acdd3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:22.736806 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a740938f-5812-4f46-bfe8-486a6acdd3c5 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:22.737086 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a740938f-5812-4f46-bfe8-486a6acdd3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:22.737358 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a740938f-5812-4f46-bfe8-486a6acdd3c5 None admin] PATH_INFO: `/v3/users/10bd00684b524d61b436781e07111a43` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:22.738684 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a740938f-5812-4f46-bfe8-486a6acdd3c5 None admin] RBAC: Authorizing `identity:get_user(user_id=10bd00684b524d61b436781e07111a43)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:22.740179 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a740938f-5812-4f46-bfe8-486a6acdd3c5 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:22.741904 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 44/84] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Aug 18 19:27:22 2022] GET /identity/v3/users/10bd00684b524d61b436781e07111a43 => generated 275 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:27:22.742726 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a740938f-5812-4f46-bfe8-486a6acdd3c5 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:22.805981 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:22.820807 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f6257b-4694-44aa-942d-70e2488f330a None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:22.861810 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a740938f-5812-4f46-bfe8-486a6acdd3c5 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:22.863123 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00304c56-42b8-4c5b-be15-53eb0ec5b4c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:22.863967 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00304c56-42b8-4c5b-be15-53eb0ec5b4c9 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:22.864252 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00304c56-42b8-4c5b-be15-53eb0ec5b4c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:22.864537 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00304c56-42b8-4c5b-be15-53eb0ec5b4c9 None admin] PATH_INFO: `/v3/projects/84c3b97bc50848039730cfaab66f74f9` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:22.865912 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00304c56-42b8-4c5b-be15-53eb0ec5b4c9 None admin] RBAC: Authorizing `identity:get_project(project_id=84c3b97bc50848039730cfaab66f74f9)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:22.867746 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00304c56-42b8-4c5b-be15-53eb0ec5b4c9 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:22.869370 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 41/85] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Aug 18 19:27:22 2022] GET /identity/v3/projects/84c3b97bc50848039730cfaab66f74f9 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:27:22.870178 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00304c56-42b8-4c5b-be15-53eb0ec5b4c9 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:22.899840 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e07264-0136-4407-bbbc-4ff860995b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:22.900454 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e07264-0136-4407-bbbc-4ff860995b4b None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:22.900734 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e07264-0136-4407-bbbc-4ff860995b4b None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:22.901009 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e07264-0136-4407-bbbc-4ff860995b4b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:22.960369 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:22.982241 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e07264-0136-4407-bbbc-4ff860995b4b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:22.983861 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e07264-0136-4407-bbbc-4ff860995b4b None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:22.997715 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00304c56-42b8-4c5b-be15-53eb0ec5b4c9 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:23.038267 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9fe1e3-aa22-40c8-8b4f-97de4b23cb2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:23.039050 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9fe1e3-aa22-40c8-8b4f-97de4b23cb2e None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:23.039340 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9fe1e3-aa22-40c8-8b4f-97de4b23cb2e None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:23.039628 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9fe1e3-aa22-40c8-8b4f-97de4b23cb2e None admin] PATH_INFO: `/v3/roles` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:23.040676 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9fe1e3-aa22-40c8-8b4f-97de4b23cb2e None admin] RBAC: Adding query filter params (name=member) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:27:23.041309 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9fe1e3-aa22-40c8-8b4f-97de4b23cb2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:23.042919 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9fe1e3-aa22-40c8-8b4f-97de4b23cb2e None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:23.056209 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 42/86] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Aug 18 19:27:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:27:23.057060 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9fe1e3-aa22-40c8-8b4f-97de4b23cb2e None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:23.090077 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:23.104898 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 45/87] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Aug 18 19:27:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 19:27:23.105938 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e07264-0136-4407-bbbc-4ff860995b4b None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:23.198706 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9fe1e3-aa22-40c8-8b4f-97de4b23cb2e None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:23.199212 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:23.215519 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e07264-0136-4407-bbbc-4ff860995b4b None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:23.246108 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cea234e-dbac-403b-9cb4-9267cf555887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:23.246748 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea234e-dbac-403b-9cb4-9267cf555887 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:23.247034 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea234e-dbac-403b-9cb4-9267cf555887 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:23.247312 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea234e-dbac-403b-9cb4-9267cf555887 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:23.255120 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa93333-5624-48b9-ba58-9d24a734a644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:23.255988 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa93333-5624-48b9-ba58-9d24a734a644 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:23.256464 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa93333-5624-48b9-ba58-9d24a734a644 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:23.256927 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa93333-5624-48b9-ba58-9d24a734a644 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:23.257939 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa93333-5624-48b9-ba58-9d24a734a644 None admin] RBAC: Adding query filter params (role.id=ece5eb2bd1334192b3eee1b7b05c042c, scope.project.id=84c3b97bc50848039730cfaab66f74f9, user.id=10bd00684b524d61b436781e07111a43) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:27:23.258447 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa93333-5624-48b9-ba58-9d24a734a644 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:23.260095 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa93333-5624-48b9-ba58-9d24a734a644 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:23.266030 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 46/88] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Aug 18 19:27:23 2022] GET /identity/v3/role_assignments?user.id=10bd00684b524d61b436781e07111a43&scope.project.id=84c3b97bc50848039730cfaab66f74f9&role.id=ece5eb2bd1334192b3eee1b7b05c042c => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:27:23.267094 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa93333-5624-48b9-ba58-9d24a734a644 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:23.336964 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cea234e-dbac-403b-9cb4-9267cf555887 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:23.338980 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cea234e-dbac-403b-9cb4-9267cf555887 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:23.363334 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:23.468843 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 43/89] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Aug 18 19:27:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 19:27:23.470022 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cea234e-dbac-403b-9cb4-9267cf555887 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:23.493407 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa93333-5624-48b9-ba58-9d24a734a644 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:23.552882 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2290c1b-6ae0-435b-8e5e-4039f67fb01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:23.553441 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2290c1b-6ae0-435b-8e5e-4039f67fb01e None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:23.553750 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2290c1b-6ae0-435b-8e5e-4039f67fb01e None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:23.554025 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2290c1b-6ae0-435b-8e5e-4039f67fb01e None admin] PATH_INFO: `/v3/users/10bd00684b524d61b436781e07111a43` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:23.555851 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2290c1b-6ae0-435b-8e5e-4039f67fb01e None admin] RBAC: Authorizing `identity:get_user(user_id=10bd00684b524d61b436781e07111a43)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:23.557297 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2290c1b-6ae0-435b-8e5e-4039f67fb01e None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:23.562087 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 47/90] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Aug 18 19:27:23 2022] GET /identity/v3/users/10bd00684b524d61b436781e07111a43 => generated 275 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:27:23.562877 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2290c1b-6ae0-435b-8e5e-4039f67fb01e None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:23.590031 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:23.634896 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cea234e-dbac-403b-9cb4-9267cf555887 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:23.657913 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:23.676321 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7723a7ea-2817-4089-9434-c787dfc8f4f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:23.677095 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7723a7ea-2817-4089-9434-c787dfc8f4f9 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:23.677501 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7723a7ea-2817-4089-9434-c787dfc8f4f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:23.677870 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7723a7ea-2817-4089-9434-c787dfc8f4f9 None admin] PATH_INFO: `/v3/projects/84c3b97bc50848039730cfaab66f74f9` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:23.679304 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7723a7ea-2817-4089-9434-c787dfc8f4f9 None admin] RBAC: Authorizing `identity:get_project(project_id=84c3b97bc50848039730cfaab66f74f9)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:23.680653 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7723a7ea-2817-4089-9434-c787dfc8f4f9 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:23.682394 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 44/91] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Aug 18 19:27:23 2022] GET /identity/v3/projects/84c3b97bc50848039730cfaab66f74f9 => generated 298 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:27:23.683246 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7723a7ea-2817-4089-9434-c787dfc8f4f9 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:23.725242 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2290c1b-6ae0-435b-8e5e-4039f67fb01e None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:23.767804 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d862a1-0c49-4a2a-a246-4647dac94392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:23.768679 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d862a1-0c49-4a2a-a246-4647dac94392 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:23.769878 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d862a1-0c49-4a2a-a246-4647dac94392 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:23.771129 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d862a1-0c49-4a2a-a246-4647dac94392 None admin] PATH_INFO: `/v3/projects/84c3b97bc50848039730cfaab66f74f9` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:23.772626 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d862a1-0c49-4a2a-a246-4647dac94392 None admin] RBAC: Authorizing `identity:get_project(project_id=84c3b97bc50848039730cfaab66f74f9)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:23.775272 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d862a1-0c49-4a2a-a246-4647dac94392 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:23.793406 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 48/92] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Aug 18 19:27:23 2022] GET /identity/v3/projects/84c3b97bc50848039730cfaab66f74f9 => generated 298 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:27:23.793406 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d862a1-0c49-4a2a-a246-4647dac94392 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:23.855995 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7723a7ea-2817-4089-9434-c787dfc8f4f9 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:23.926748 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850ba6a3-ca69-4cbd-af15-af76bb5f6fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:23.927374 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850ba6a3-ca69-4cbd-af15-af76bb5f6fd7 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:23.927658 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850ba6a3-ca69-4cbd-af15-af76bb5f6fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:23.927935 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850ba6a3-ca69-4cbd-af15-af76bb5f6fd7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:23.954851 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:23.989408 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d862a1-0c49-4a2a-a246-4647dac94392 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:24.080330 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:24.098008 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850ba6a3-ca69-4cbd-af15-af76bb5f6fd7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:24.100285 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850ba6a3-ca69-4cbd-af15-af76bb5f6fd7 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:24.150381 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6228399-ed42-463a-b734-fca6ba5f11a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:24.151023 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6228399-ed42-463a-b734-fca6ba5f11a4 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:24.151363 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6228399-ed42-463a-b734-fca6ba5f11a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:24.151585 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6228399-ed42-463a-b734-fca6ba5f11a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:24.152320 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6228399-ed42-463a-b734-fca6ba5f11a4 None admin] RBAC: Adding query filter params (role.id=33fe6be3baf44b969c8166af5142e0c7, scope.project.id=84c3b97bc50848039730cfaab66f74f9, user.id=f765ddb0f75b40179001f4a64546ab53) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:27:24.152631 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6228399-ed42-463a-b734-fca6ba5f11a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:24.154835 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6228399-ed42-463a-b734-fca6ba5f11a4 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:24.175596 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 49/93] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Aug 18 19:27:23 2022] GET /identity/v3/role_assignments?user.id=f765ddb0f75b40179001f4a64546ab53&scope.project.id=84c3b97bc50848039730cfaab66f74f9&role.id=33fe6be3baf44b969c8166af5142e0c7 => generated 259 bytes in 386 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:27:24.176272 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6228399-ed42-463a-b734-fca6ba5f11a4 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:24.244693 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 45/94] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Aug 18 19:27:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 562 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 19:27:24.250018 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850ba6a3-ca69-4cbd-af15-af76bb5f6fd7 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:24.400765 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6228399-ed42-463a-b734-fca6ba5f11a4 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:24.433589 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:24.459280 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850ba6a3-ca69-4cbd-af15-af76bb5f6fd7 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:24.469621 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff9ff80-caf6-4a7a-bcac-0b18ab8d84db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:24.470272 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff9ff80-caf6-4a7a-bcac-0b18ab8d84db None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:24.470553 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff9ff80-caf6-4a7a-bcac-0b18ab8d84db None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:24.470825 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff9ff80-caf6-4a7a-bcac-0b18ab8d84db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:24.471557 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff9ff80-caf6-4a7a-bcac-0b18ab8d84db None admin] RBAC: Adding query filter params (role.id=629bead347a8449ebece758b5a7ae23d, scope.project.id=84c3b97bc50848039730cfaab66f74f9, user.id=10bd00684b524d61b436781e07111a43) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:27:24.471902 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff9ff80-caf6-4a7a-bcac-0b18ab8d84db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:24.473405 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff9ff80-caf6-4a7a-bcac-0b18ab8d84db None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:24.482998 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 50/95] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Aug 18 19:27:24 2022] GET /identity/v3/role_assignments?user.id=10bd00684b524d61b436781e07111a43&scope.project.id=84c3b97bc50848039730cfaab66f74f9&role.id=629bead347a8449ebece758b5a7ae23d => generated 259 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:27:24.507734 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b93445-f938-40bc-928e-ae8f79b36cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:24.508374 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b93445-f938-40bc-928e-ae8f79b36cf3 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:24.508653 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b93445-f938-40bc-928e-ae8f79b36cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:24.508924 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b93445-f938-40bc-928e-ae8f79b36cf3 None admin] PATH_INFO: `/v3/projects/53d8edf14381441f925c723e97ecf41b` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:24.510552 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b93445-f938-40bc-928e-ae8f79b36cf3 None admin] RBAC: Authorizing `identity:get_project(project_id=53d8edf14381441f925c723e97ecf41b)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:24.512101 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b93445-f938-40bc-928e-ae8f79b36cf3 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:24.513913 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 46/96] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Aug 18 19:27:24 2022] GET /identity/v3/projects/53d8edf14381441f925c723e97ecf41b => generated 312 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:27:24.519928 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff9ff80-caf6-4a7a-bcac-0b18ab8d84db None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:24.542425 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:24.657931 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff9ff80-caf6-4a7a-bcac-0b18ab8d84db None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:24.703713 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f47ff5-089d-48e4-aee4-53bd9405332b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:24.704344 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f47ff5-089d-48e4-aee4-53bd9405332b None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:24.704625 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f47ff5-089d-48e4-aee4-53bd9405332b None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:24.704897 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f47ff5-089d-48e4-aee4-53bd9405332b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:24.705638 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f47ff5-089d-48e4-aee4-53bd9405332b None admin] RBAC: Adding query filter params (role.id=ece5eb2bd1334192b3eee1b7b05c042c, scope.project.id=53d8edf14381441f925c723e97ecf41b, user.id=10bd00684b524d61b436781e07111a43) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:27:24.705976 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f47ff5-089d-48e4-aee4-53bd9405332b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:24.707519 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f47ff5-089d-48e4-aee4-53bd9405332b None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:24.718621 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 51/97] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Aug 18 19:27:24 2022] GET /identity/v3/role_assignments?user.id=10bd00684b524d61b436781e07111a43&scope.project.id=53d8edf14381441f925c723e97ecf41b&role.id=ece5eb2bd1334192b3eee1b7b05c042c => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:27:25.604267 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05846b93-316b-403f-a2aa-32f43f53fc09 None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:25.604780 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05846b93-316b-403f-a2aa-32f43f53fc09 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:25.604854 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05846b93-316b-403f-a2aa-32f43f53fc09 None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:25.606412 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 47/98] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:27:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:27:25.611726 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fec9a7-0f98-47f5-aaa0-3530a2715e11 None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:25.612121 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fec9a7-0f98-47f5-aaa0-3530a2715e11 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:25.612298 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fec9a7-0f98-47f5-aaa0-3530a2715e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:25.634658 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-16fec9a7-0f98-47f5-aaa0-3530a2715e11 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:27:25.635863 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-16fec9a7-0f98-47f5-aaa0-3530a2715e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:27:25.712563 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 52/99] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:27:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:27:25.781613 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba531b-e110-4b45-bfb5-1b63f488307f None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:25.781959 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba531b-e110-4b45-bfb5-1b63f488307f None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:25.782163 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba531b-e110-4b45-bfb5-1b63f488307f None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:25.783649 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 48/100] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:27:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:27:25.791612 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c279eb-cb48-4ff7-a74d-bdcdc42e9907 None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:25.791906 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c279eb-cb48-4ff7-a74d-bdcdc42e9907 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:25.792181 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c279eb-cb48-4ff7-a74d-bdcdc42e9907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:25.806788 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:25.812849 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-78c279eb-cb48-4ff7-a74d-bdcdc42e9907 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:27:25.814293 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-78c279eb-cb48-4ff7-a74d-bdcdc42e9907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:27:25.892239 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 53/101] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:27:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 19:27:26.219684 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e35b0f0-fb84-4c28-abd5-ab5f0e2508f9 None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:26.220016 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e35b0f0-fb84-4c28-abd5-ab5f0e2508f9 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:26.220200 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e35b0f0-fb84-4c28-abd5-ab5f0e2508f9 None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:26.221835 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 49/102] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:27:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:27:26.227142 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a34bdd-79ef-44ad-b35e-f117ead55895 None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:26.227719 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a34bdd-79ef-44ad-b35e-f117ead55895 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:26.228187 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a34bdd-79ef-44ad-b35e-f117ead55895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:26.254052 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-13a34bdd-79ef-44ad-b35e-f117ead55895 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:27:26.255590 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-13a34bdd-79ef-44ad-b35e-f117ead55895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:27:26.304243 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e35b0f0-fb84-4c28-abd5-ab5f0e2508f9 None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:26.337690 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 54/103] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:27:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:27:26.411274 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a34bdd-79ef-44ad-b35e-f117ead55895 None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:26.491468 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e35b0f0-fb84-4c28-abd5-ab5f0e2508f9 None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:26.538149 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:26.572245 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c2a550-23b5-4bc6-95f0-46d516bf1665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:26.572910 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c2a550-23b5-4bc6-95f0-46d516bf1665 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:26.573282 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c2a550-23b5-4bc6-95f0-46d516bf1665 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:26.573572 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c2a550-23b5-4bc6-95f0-46d516bf1665 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:26.574765 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c2a550-23b5-4bc6-95f0-46d516bf1665 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:26.576232 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c2a550-23b5-4bc6-95f0-46d516bf1665 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:26.577846 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 50/104] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Aug 18 19:27:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:27:26.583421 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c2a550-23b5-4bc6-95f0-46d516bf1665 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:26.625733 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a34bdd-79ef-44ad-b35e-f117ead55895 None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:26.632594 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:26.699714 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025372da-9cee-4e1a-a411-588baefa182a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:26.700357 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025372da-9cee-4e1a-a411-588baefa182a None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:26.700640 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025372da-9cee-4e1a-a411-588baefa182a None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:26.700917 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025372da-9cee-4e1a-a411-588baefa182a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:26.730244 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025372da-9cee-4e1a-a411-588baefa182a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:27:26.735149 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application [None req-025372da-9cee-4e1a-a411-588baefa182a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 19:27:26.735149 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:27:26.735149 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:27:26.735149 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:27:26.735149 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:27:26.735149 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:27:26.735149 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:27:26.735149 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:27:26.735149 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:27:26.735149 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:27:26.735149 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:27:26.735149 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:27:26.735149 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:27:26.735149 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:27:26.735149 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:27:26.735149 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:27:26.735988 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:27:26.735988 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:27:26.735988 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:27:26.735988 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:27:26.735988 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:27:26.735988 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:27:26.735988 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:27:26.735988 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:27:26.735988 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:27:26.735988 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:27:26.735988 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:27:26.735988 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application with Lock( Aug 18 19:27:26.735988 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:27:26.735988 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:27:26.735988 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:27:26.735988 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:27:26.736746 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:27:26.736746 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:27:26.736746 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:27:26.736746 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:27:26.736746 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:27:26.736746 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:27:26.736746 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:27:26.736746 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:27:26.736746 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:27:26.736746 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:27:26.736746 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 19:27:26.736746 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:27:26.736746 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 55/105] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Aug 18 19:27:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 19:27:26.742207 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025372da-9cee-4e1a-a411-588baefa182a None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:26.793001 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c2a550-23b5-4bc6-95f0-46d516bf1665 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:26.861595 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54f09e6-0ce8-40a2-ab76-c95437d36ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:26.862823 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f09e6-0ce8-40a2-ab76-c95437d36ed5 None admin] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:26.863334 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f09e6-0ce8-40a2-ab76-c95437d36ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:26.864294 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f09e6-0ce8-40a2-ab76-c95437d36ed5 None admin] PATH_INFO: `/v3/projects` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:26.865450 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54f09e6-0ce8-40a2-ab76-c95437d36ed5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:26.867101 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54f09e6-0ce8-40a2-ab76-c95437d36ed5 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:26.923566 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025372da-9cee-4e1a-a411-588baefa182a None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:26.962425 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:26.974184 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa49ac02-d25f-4aa9-b942-0d9d1fe2690b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:26.974806 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa49ac02-d25f-4aa9-b942-0d9d1fe2690b None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:26.975090 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa49ac02-d25f-4aa9-b942-0d9d1fe2690b None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:26.975367 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa49ac02-d25f-4aa9-b942-0d9d1fe2690b None admin] PATH_INFO: `/v3/roles` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:26.976039 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa49ac02-d25f-4aa9-b942-0d9d1fe2690b None admin] RBAC: Adding query filter params (name=reader) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:27:26.976343 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa49ac02-d25f-4aa9-b942-0d9d1fe2690b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:26.977760 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa49ac02-d25f-4aa9-b942-0d9d1fe2690b None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:26.986300 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 56/106] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Aug 18 19:27:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:27:26.987119 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa49ac02-d25f-4aa9-b942-0d9d1fe2690b None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:26.989066 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 51/107] 10.222.0.23 () {60 vars in 1141 bytes} [Thu Aug 18 19:27:26 2022] POST /identity/v3/projects => generated 302 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 19:27:26.992736 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54f09e6-0ce8-40a2-ab76-c95437d36ed5 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:27.100091 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa49ac02-d25f-4aa9-b942-0d9d1fe2690b None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:27.139083 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42604710-6879-420e-809e-72b07c9e4a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:27.139730 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42604710-6879-420e-809e-72b07c9e4a18 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:27.140183 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42604710-6879-420e-809e-72b07c9e4a18 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:27.140474 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42604710-6879-420e-809e-72b07c9e4a18 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:27.152526 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42604710-6879-420e-809e-72b07c9e4a18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:27:27.157903 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application [None req-42604710-6879-420e-809e-72b07c9e4a18 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 19:27:27.157903 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:27:27.157903 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:27:27.157903 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:27:27.157903 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:27:27.157903 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:27:27.157903 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:27:27.157903 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:27:27.157903 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:27:27.157903 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:27:27.157903 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:27:27.157903 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:27:27.157903 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:27:27.157903 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:27:27.157903 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:27:27.157903 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:27:27.158796 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:27:27.158796 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:27:27.158796 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:27:27.158796 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:27:27.158796 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:27:27.158796 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:27:27.158796 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:27:27.158796 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:27:27.158796 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:27:27.158796 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:27:27.158796 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:27:27.158796 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application with Lock( Aug 18 19:27:27.158796 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:27:27.158796 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:27:27.158796 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:27:27.158796 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:27:27.160098 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:27:27.160098 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:27:27.160098 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:27:27.160098 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:27:27.160098 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:27:27.160098 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:27:27.160098 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:27:27.160098 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:27:27.160098 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:27:27.160098 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:27:27.160098 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 19:27:27.160098 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:27:27.160098 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 57/108] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Aug 18 19:27:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:27:27.166999 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42604710-6879-420e-809e-72b07c9e4a18 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:27.196824 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:27.258163 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54f09e6-0ce8-40a2-ab76-c95437d36ed5 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:27.271934 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:27.326223 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139ced03-0165-4bb7-8a6f-25845d72aff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:27.327446 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139ced03-0165-4bb7-8a6f-25845d72aff0 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:27.329456 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139ced03-0165-4bb7-8a6f-25845d72aff0 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:27.330033 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139ced03-0165-4bb7-8a6f-25845d72aff0 None admin] PATH_INFO: `/v3/users/99e51f0d1fad49f3a25eacec953f0008` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:27.351838 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139ced03-0165-4bb7-8a6f-25845d72aff0 None admin] RBAC: Authorizing `identity:get_user(user_id=99e51f0d1fad49f3a25eacec953f0008)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:27.353303 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139ced03-0165-4bb7-8a6f-25845d72aff0 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:27.357919 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 52/109] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Aug 18 19:27:26 2022] GET /identity/v3/users/99e51f0d1fad49f3a25eacec953f0008 => generated 289 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:27:27.357919 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7882ea5-a4d7-468a-a701-68d625a48761 None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:27.357919 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7882ea5-a4d7-468a-a701-68d625a48761 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:27.358988 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7882ea5-a4d7-468a-a701-68d625a48761 None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:27.363840 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 53/110] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:27:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:27:27.364818 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7882ea5-a4d7-468a-a701-68d625a48761 None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:27.365466 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42604710-6879-420e-809e-72b07c9e4a18 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:27.413377 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88849fe-0cb1-4c3e-b445-1b3005239043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:27.414040 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88849fe-0cb1-4c3e-b445-1b3005239043 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:27.414325 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88849fe-0cb1-4c3e-b445-1b3005239043 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:27.414603 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88849fe-0cb1-4c3e-b445-1b3005239043 None admin] PATH_INFO: `/v3/roles` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:27.416727 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88849fe-0cb1-4c3e-b445-1b3005239043 None admin] RBAC: Adding query filter params (name=member) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:27:27.417052 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88849fe-0cb1-4c3e-b445-1b3005239043 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:27.418494 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88849fe-0cb1-4c3e-b445-1b3005239043 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:27.430512 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 58/111] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Aug 18 19:27:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:27:27.433891 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b38c1ac-28d1-49ba-ab75-9e3a9bb036d3 None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:27.434257 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b38c1ac-28d1-49ba-ab75-9e3a9bb036d3 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:27.434543 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b38c1ac-28d1-49ba-ab75-9e3a9bb036d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:27.459384 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-0b38c1ac-28d1-49ba-ab75-9e3a9bb036d3 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:27:27.460641 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-0b38c1ac-28d1-49ba-ab75-9e3a9bb036d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:27:27.491036 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7882ea5-a4d7-468a-a701-68d625a48761 None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:27.532643 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:27.539676 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dae67d8-be13-4cc8-bac1-1ac8d5c691ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:27.540343 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae67d8-be13-4cc8-bac1-1ac8d5c691ce None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:27.540634 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae67d8-be13-4cc8-bac1-1ac8d5c691ce None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:27.540914 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae67d8-be13-4cc8-bac1-1ac8d5c691ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:27.554176 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 59/112] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:27:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:27:27.555585 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b38c1ac-28d1-49ba-ab75-9e3a9bb036d3 None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:27.622979 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:27.627044 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dae67d8-be13-4cc8-bac1-1ac8d5c691ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:27.628576 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dae67d8-be13-4cc8-bac1-1ac8d5c691ce None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:27.699182 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b38c1ac-28d1-49ba-ab75-9e3a9bb036d3 None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:27.747623 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e8a64f-d5a9-49f0-8e48-3ea0c6d1ca8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:27.748639 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e8a64f-d5a9-49f0-8e48-3ea0c6d1ca8f None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:27.749108 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e8a64f-d5a9-49f0-8e48-3ea0c6d1ca8f None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:27.749565 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e8a64f-d5a9-49f0-8e48-3ea0c6d1ca8f None admin] PATH_INFO: `/v3/users/10bd00684b524d61b436781e07111a43` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:27.751245 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e8a64f-d5a9-49f0-8e48-3ea0c6d1ca8f None admin] RBAC: Authorizing `identity:get_user(user_id=10bd00684b524d61b436781e07111a43)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:27.753161 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e8a64f-d5a9-49f0-8e48-3ea0c6d1ca8f None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:27.755306 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 60/113] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Aug 18 19:27:27 2022] GET /identity/v3/users/10bd00684b524d61b436781e07111a43 => generated 275 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:27:27.761558 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e8a64f-d5a9-49f0-8e48-3ea0c6d1ca8f None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:27.773232 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 54/114] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Aug 18 19:27:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 19:27:27.778187 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dae67d8-be13-4cc8-bac1-1ac8d5c691ce None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:27.858732 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:27.882127 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e8a64f-d5a9-49f0-8e48-3ea0c6d1ca8f None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:27.894248 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:27.947645 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1bb7b7-b847-45ce-a648-a4e118ae0c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:27.948295 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1bb7b7-b847-45ce-a648-a4e118ae0c8a None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:27.948579 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1bb7b7-b847-45ce-a648-a4e118ae0c8a None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:27.948853 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1bb7b7-b847-45ce-a648-a4e118ae0c8a None admin] PATH_INFO: `/v3/projects/84c3b97bc50848039730cfaab66f74f9` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:27.950649 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1bb7b7-b847-45ce-a648-a4e118ae0c8a None admin] RBAC: Authorizing `identity:get_project(project_id=84c3b97bc50848039730cfaab66f74f9)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:27.952094 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1bb7b7-b847-45ce-a648-a4e118ae0c8a None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:27.954047 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 61/115] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Aug 18 19:27:27 2022] GET /identity/v3/projects/84c3b97bc50848039730cfaab66f74f9 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:27:27.958363 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb9968a-c2fb-4664-9068-9c6d181a9146 None None] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:27.958647 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb9968a-c2fb-4664-9068-9c6d181a9146 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:27.958918 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb9968a-c2fb-4664-9068-9c6d181a9146 None None] PATH_INFO: `/` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:27.960277 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 62/116] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:27:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:27:27.960826 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb9968a-c2fb-4664-9068-9c6d181a9146 None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:27.991483 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dae67d8-be13-4cc8-bac1-1ac8d5c691ce None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:28.048016 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347aa453-5387-4ece-9ea1-986234110cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:28.048657 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347aa453-5387-4ece-9ea1-986234110cdc None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:28.048938 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347aa453-5387-4ece-9ea1-986234110cdc None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:28.049212 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347aa453-5387-4ece-9ea1-986234110cdc None admin] PATH_INFO: `/v3/projects/84c3b97bc50848039730cfaab66f74f9` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:28.050433 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347aa453-5387-4ece-9ea1-986234110cdc None admin] RBAC: Authorizing `identity:get_project(project_id=84c3b97bc50848039730cfaab66f74f9)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:28.051862 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347aa453-5387-4ece-9ea1-986234110cdc None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:28.053587 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 55/117] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Aug 18 19:27:27 2022] GET /identity/v3/projects/84c3b97bc50848039730cfaab66f74f9 => generated 298 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:27:28.054832 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e57d4ac-892f-4a14-ac3f-97621e9788b1 None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:28.055111 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e57d4ac-892f-4a14-ac3f-97621e9788b1 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:28.055383 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e57d4ac-892f-4a14-ac3f-97621e9788b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:28.085697 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-5e57d4ac-892f-4a14-ac3f-97621e9788b1 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:27:28.087368 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-5e57d4ac-892f-4a14-ac3f-97621e9788b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:27:28.152641 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb9968a-c2fb-4664-9068-9c6d181a9146 None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:28.174577 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 56/118] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:27:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:27:28.176323 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e57d4ac-892f-4a14-ac3f-97621e9788b1 None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:28.224460 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fe33bf-b210-49b1-8f9e-c6fd62af3af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:28.225192 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe33bf-b210-49b1-8f9e-c6fd62af3af1 None admin] REQUEST_METHOD: `PUT` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:28.225482 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe33bf-b210-49b1-8f9e-c6fd62af3af1 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:28.225826 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe33bf-b210-49b1-8f9e-c6fd62af3af1 None admin] PATH_INFO: `/v3/projects/84c3b97bc50848039730cfaab66f74f9/users/10bd00684b524d61b436781e07111a43/roles/ece5eb2bd1334192b3eee1b7b05c042c` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:28.228621 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fe33bf-b210-49b1-8f9e-c6fd62af3af1 None admin] RBAC: Authorizing `identity:create_grant(project_id=84c3b97bc50848039730cfaab66f74f9, user_id=10bd00684b524d61b436781e07111a43, role_id=ece5eb2bd1334192b3eee1b7b05c042c)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:28.230078 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:28.230197 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fe33bf-b210-49b1-8f9e-c6fd62af3af1 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:28.283695 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e57d4ac-892f-4a14-ac3f-97621e9788b1 None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:28.314380 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 63/119] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Aug 18 19:27:27 2022] PUT /identity/v3/projects/84c3b97bc50848039730cfaab66f74f9/users/10bd00684b524d61b436781e07111a43/roles/ece5eb2bd1334192b3eee1b7b05c042c => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 19:27:28.315216 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fe33bf-b210-49b1-8f9e-c6fd62af3af1 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:28.348925 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc3c169-fcfe-4d85-8574-d402d037f7cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:28.349498 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc3c169-fcfe-4d85-8574-d402d037f7cb None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:28.349812 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc3c169-fcfe-4d85-8574-d402d037f7cb None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:28.350087 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc3c169-fcfe-4d85-8574-d402d037f7cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:28.350831 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc3c169-fcfe-4d85-8574-d402d037f7cb None admin] RBAC: Adding query filter params (role.id=9aa2d4ac6d7540c68a34e8ffba0e545d, scope.project.id=84c3b97bc50848039730cfaab66f74f9, user.id=99e51f0d1fad49f3a25eacec953f0008) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:27:28.357462 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc3c169-fcfe-4d85-8574-d402d037f7cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:28.357462 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc3c169-fcfe-4d85-8574-d402d037f7cb None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:28.369269 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:28.375675 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 57/120] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Aug 18 19:27:28 2022] GET /identity/v3/role_assignments?user.id=99e51f0d1fad49f3a25eacec953f0008&scope.project.id=84c3b97bc50848039730cfaab66f74f9&role.id=9aa2d4ac6d7540c68a34e8ffba0e545d => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:27:28.376873 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27196847-36d2-4a9a-b130-10fb2bda37ed None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:28.377165 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27196847-36d2-4a9a-b130-10fb2bda37ed None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:28.377443 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27196847-36d2-4a9a-b130-10fb2bda37ed None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:28.379630 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 58/121] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:27:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:27:28.385690 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40beee90-db32-4dbd-8ad5-1bb59ccc601a None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:28.385976 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40beee90-db32-4dbd-8ad5-1bb59ccc601a None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:28.386257 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40beee90-db32-4dbd-8ad5-1bb59ccc601a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:28.406589 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-40beee90-db32-4dbd-8ad5-1bb59ccc601a None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:27:28.407770 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-40beee90-db32-4dbd-8ad5-1bb59ccc601a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:27:28.445338 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fe33bf-b210-49b1-8f9e-c6fd62af3af1 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:28.487750 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40604ce3-0240-4e3f-be04-d7e1afe88013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:28.488411 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40604ce3-0240-4e3f-be04-d7e1afe88013 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:28.488754 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40604ce3-0240-4e3f-be04-d7e1afe88013 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:28.489032 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40604ce3-0240-4e3f-be04-d7e1afe88013 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:28.503353 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40604ce3-0240-4e3f-be04-d7e1afe88013 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:27:28.508535 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application [None req-40604ce3-0240-4e3f-be04-d7e1afe88013 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 19:27:28.508535 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:27:28.508535 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:27:28.508535 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:27:28.508535 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:27:28.508535 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:27:28.508535 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:27:28.508535 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:27:28.508535 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:27:28.508535 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:27:28.508535 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:27:28.508535 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:27:28.508535 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:27:28.508535 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:27:28.508535 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:27:28.508535 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:27:28.509438 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:27:28.509438 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:27:28.509438 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:27:28.509438 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:27:28.509438 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:27:28.509438 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:27:28.509438 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:27:28.509438 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:27:28.509438 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:27:28.509438 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:27:28.509438 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:27:28.509438 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application with Lock( Aug 18 19:27:28.509438 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:27:28.509438 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:27:28.509438 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:27:28.509438 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:27:28.510342 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:27:28.510342 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:27:28.510342 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:27:28.510342 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:27:28.510342 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:27:28.510342 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:27:28.510342 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:27:28.510342 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:27:28.510342 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:27:28.510342 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:27:28.510342 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 19:27:28.510342 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:27:28.510342 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 64/122] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Aug 18 19:27:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:27:28.517180 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40604ce3-0240-4e3f-be04-d7e1afe88013 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:28.647274 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 59/123] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:27:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:27:28.648695 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40beee90-db32-4dbd-8ad5-1bb59ccc601a None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:28.649327 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:28.656810 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40604ce3-0240-4e3f-be04-d7e1afe88013 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:28.678939 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:28.706259 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b725d260-c79c-4e7e-b283-ca0e76e4d424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:28.706926 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b725d260-c79c-4e7e-b283-ca0e76e4d424 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:28.707185 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b725d260-c79c-4e7e-b283-ca0e76e4d424 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:28.707503 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b725d260-c79c-4e7e-b283-ca0e76e4d424 None admin] PATH_INFO: `/v3/roles` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:28.708268 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b725d260-c79c-4e7e-b283-ca0e76e4d424 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:27:28.708582 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b725d260-c79c-4e7e-b283-ca0e76e4d424 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:28.710244 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b725d260-c79c-4e7e-b283-ca0e76e4d424 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:28.722665 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 65/124] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Aug 18 19:27:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:27:28.728134 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b725d260-c79c-4e7e-b283-ca0e76e4d424 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:28.771208 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40beee90-db32-4dbd-8ad5-1bb59ccc601a None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:28.809365 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0c670b-dcae-4521-8b86-5a485f441b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:28.810837 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0c670b-dcae-4521-8b86-5a485f441b54 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:28.811319 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0c670b-dcae-4521-8b86-5a485f441b54 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:28.811817 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0c670b-dcae-4521-8b86-5a485f441b54 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:28.823782 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0c670b-dcae-4521-8b86-5a485f441b54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:27:28.829233 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application [None req-cb0c670b-dcae-4521-8b86-5a485f441b54 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 19:27:28.829233 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:27:28.829233 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:27:28.829233 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:27:28.829233 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:27:28.829233 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:27:28.829233 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:27:28.829233 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:27:28.829233 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:27:28.829233 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:27:28.829233 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:27:28.829233 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:27:28.829233 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:27:28.829233 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:27:28.829233 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:27:28.829233 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:27:28.830187 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:27:28.830187 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:27:28.830187 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:27:28.830187 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:27:28.830187 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:27:28.830187 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:27:28.830187 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:27:28.830187 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:27:28.830187 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:27:28.830187 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:27:28.830187 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:27:28.830187 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application with Lock( Aug 18 19:27:28.830187 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:27:28.830187 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:27:28.830187 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:27:28.830187 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:27:28.831010 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:27:28.831010 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:27:28.831010 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:27:28.831010 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:27:28.831010 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:27:28.831010 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:27:28.831010 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:27:28.831010 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:27:28.831010 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:27:28.831010 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:27:28.831010 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 19:27:28.831010 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:27:28.833513 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 60/125] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Aug 18 19:27:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:27:28.840111 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0c670b-dcae-4521-8b86-5a485f441b54 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:28.840766 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b725d260-c79c-4e7e-b283-ca0e76e4d424 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:28.877889 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18421e59-ab96-495e-8057-38a32a223550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:28.878536 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18421e59-ab96-495e-8057-38a32a223550 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:28.878822 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18421e59-ab96-495e-8057-38a32a223550 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:28.879100 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18421e59-ab96-495e-8057-38a32a223550 None admin] PATH_INFO: `/v3/users/f765ddb0f75b40179001f4a64546ab53` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:28.881028 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18421e59-ab96-495e-8057-38a32a223550 None admin] RBAC: Authorizing `identity:get_user(user_id=f765ddb0f75b40179001f4a64546ab53)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:28.881935 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18421e59-ab96-495e-8057-38a32a223550 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:28.883518 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 66/126] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Aug 18 19:27:28 2022] GET /identity/v3/users/f765ddb0f75b40179001f4a64546ab53 => generated 247 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:27:28.889159 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18421e59-ab96-495e-8057-38a32a223550 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:28.919303 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:28.935878 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:28.952966 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0c670b-dcae-4521-8b86-5a485f441b54 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:28.989639 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3046171-025e-48ec-a6f6-9ae7fb4423da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:28.990642 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3046171-025e-48ec-a6f6-9ae7fb4423da None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:28.991124 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3046171-025e-48ec-a6f6-9ae7fb4423da None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:28.991620 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3046171-025e-48ec-a6f6-9ae7fb4423da None admin] PATH_INFO: `/v3/roles` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:28.992811 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3046171-025e-48ec-a6f6-9ae7fb4423da None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:27:28.993507 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3046171-025e-48ec-a6f6-9ae7fb4423da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:28.995370 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3046171-025e-48ec-a6f6-9ae7fb4423da None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:28.996586 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18421e59-ab96-495e-8057-38a32a223550 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:29.004968 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 61/127] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Aug 18 19:27:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:27:29.010756 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3046171-025e-48ec-a6f6-9ae7fb4423da None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:29.043224 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059fc5d3-ebb7-4b72-b6f6-59913853cdba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:29.043878 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059fc5d3-ebb7-4b72-b6f6-59913853cdba None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:29.044221 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059fc5d3-ebb7-4b72-b6f6-59913853cdba None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:29.044429 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059fc5d3-ebb7-4b72-b6f6-59913853cdba None admin] PATH_INFO: `/v3/projects/84c3b97bc50848039730cfaab66f74f9` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:29.045626 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059fc5d3-ebb7-4b72-b6f6-59913853cdba None admin] RBAC: Authorizing `identity:get_project(project_id=84c3b97bc50848039730cfaab66f74f9)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:29.051524 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059fc5d3-ebb7-4b72-b6f6-59913853cdba None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:29.053111 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 67/128] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Aug 18 19:27:28 2022] GET /identity/v3/projects/84c3b97bc50848039730cfaab66f74f9 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:27:29.059263 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059fc5d3-ebb7-4b72-b6f6-59913853cdba None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:29.123114 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3046171-025e-48ec-a6f6-9ae7fb4423da None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:29.158852 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6987af60-173e-4c8c-86e1-a6b7eaac32d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:29.159874 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6987af60-173e-4c8c-86e1-a6b7eaac32d8 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:29.160381 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6987af60-173e-4c8c-86e1-a6b7eaac32d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:29.160934 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6987af60-173e-4c8c-86e1-a6b7eaac32d8 None admin] PATH_INFO: `/v3/users/10bd00684b524d61b436781e07111a43` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:29.162349 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6987af60-173e-4c8c-86e1-a6b7eaac32d8 None admin] RBAC: Authorizing `identity:get_user(user_id=10bd00684b524d61b436781e07111a43)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:29.164073 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6987af60-173e-4c8c-86e1-a6b7eaac32d8 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:29.166314 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 62/129] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Aug 18 19:27:29 2022] GET /identity/v3/users/10bd00684b524d61b436781e07111a43 => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:27:29.172099 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6987af60-173e-4c8c-86e1-a6b7eaac32d8 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:29.189794 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:29.202965 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059fc5d3-ebb7-4b72-b6f6-59913853cdba None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:29.206199 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:29.241561 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc172da3-1339-4e4b-9919-6ed21951e858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:29.243911 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc172da3-1339-4e4b-9919-6ed21951e858 None admin] REQUEST_METHOD: `PUT` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:29.244371 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc172da3-1339-4e4b-9919-6ed21951e858 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:29.244924 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc172da3-1339-4e4b-9919-6ed21951e858 None admin] PATH_INFO: `/v3/projects/84c3b97bc50848039730cfaab66f74f9/users/f765ddb0f75b40179001f4a64546ab53/roles/33fe6be3baf44b969c8166af5142e0c7` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:29.247291 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc172da3-1339-4e4b-9919-6ed21951e858 None admin] RBAC: Authorizing `identity:create_grant(project_id=84c3b97bc50848039730cfaab66f74f9, user_id=f765ddb0f75b40179001f4a64546ab53, role_id=33fe6be3baf44b969c8166af5142e0c7)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:29.248950 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc172da3-1339-4e4b-9919-6ed21951e858 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:29.283249 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6987af60-173e-4c8c-86e1-a6b7eaac32d8 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:29.319368 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7899a7b4-01b7-473a-91ba-0fa82efb7b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:29.320018 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7899a7b4-01b7-473a-91ba-0fa82efb7b88 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:29.320372 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7899a7b4-01b7-473a-91ba-0fa82efb7b88 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:29.320669 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7899a7b4-01b7-473a-91ba-0fa82efb7b88 None admin] PATH_INFO: `/v3/projects/84c3b97bc50848039730cfaab66f74f9` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:29.321882 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7899a7b4-01b7-473a-91ba-0fa82efb7b88 None admin] RBAC: Authorizing `identity:get_project(project_id=84c3b97bc50848039730cfaab66f74f9)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:29.326075 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7899a7b4-01b7-473a-91ba-0fa82efb7b88 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:29.326075 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 63/130] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Aug 18 19:27:29 2022] GET /identity/v3/projects/84c3b97bc50848039730cfaab66f74f9 => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:27:29.328296 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7899a7b4-01b7-473a-91ba-0fa82efb7b88 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:29.357770 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 68/131] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Aug 18 19:27:29 2022] PUT /identity/v3/projects/84c3b97bc50848039730cfaab66f74f9/users/f765ddb0f75b40179001f4a64546ab53/roles/33fe6be3baf44b969c8166af5142e0c7 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 19:27:29.359184 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc172da3-1339-4e4b-9919-6ed21951e858 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:29.426154 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:29.443972 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7899a7b4-01b7-473a-91ba-0fa82efb7b88 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:29.504894 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eed935-d2fe-46b7-b332-8efd50fdd471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:29.505555 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eed935-d2fe-46b7-b332-8efd50fdd471 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:29.505859 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eed935-d2fe-46b7-b332-8efd50fdd471 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:29.506132 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eed935-d2fe-46b7-b332-8efd50fdd471 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:29.532567 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eed935-d2fe-46b7-b332-8efd50fdd471 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:27:29.546498 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application [None req-99eed935-d2fe-46b7-b332-8efd50fdd471 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 19:27:29.546498 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:27:29.546498 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:27:29.546498 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:27:29.546498 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:27:29.546498 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:27:29.546498 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:27:29.546498 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:27:29.546498 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:27:29.546498 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:27:29.546498 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:27:29.546498 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:27:29.546498 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:27:29.546498 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:27:29.546498 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:27:29.546498 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:27:29.547885 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:27:29.547885 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:27:29.547885 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:27:29.547885 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:27:29.547885 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:27:29.547885 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:27:29.547885 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:27:29.547885 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:27:29.547885 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:27:29.547885 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:27:29.547885 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:27:29.547885 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application with Lock( Aug 18 19:27:29.547885 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:27:29.547885 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:27:29.547885 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:27:29.547885 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:27:29.549095 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:27:29.549095 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:27:29.549095 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:27:29.549095 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:27:29.549095 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:27:29.549095 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:27:29.549095 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:27:29.549095 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:27:29.549095 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:27:29.549095 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:27:29.549095 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 19:27:29.549095 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:27:29.551469 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 64/132] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Aug 18 19:27:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 19:27:29.562306 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eed935-d2fe-46b7-b332-8efd50fdd471 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:29.598592 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc172da3-1339-4e4b-9919-6ed21951e858 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:29.674215 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a42c6f-556c-41a0-b6f3-f1a54baa5f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:29.675452 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a42c6f-556c-41a0-b6f3-f1a54baa5f67 None admin] REQUEST_METHOD: `PUT` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:29.675734 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a42c6f-556c-41a0-b6f3-f1a54baa5f67 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:29.676006 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a42c6f-556c-41a0-b6f3-f1a54baa5f67 None admin] PATH_INFO: `/v3/projects/84c3b97bc50848039730cfaab66f74f9/users/10bd00684b524d61b436781e07111a43/roles/629bead347a8449ebece758b5a7ae23d` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:29.681604 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a42c6f-556c-41a0-b6f3-f1a54baa5f67 None admin] RBAC: Authorizing `identity:create_grant(project_id=84c3b97bc50848039730cfaab66f74f9, user_id=10bd00684b524d61b436781e07111a43, role_id=629bead347a8449ebece758b5a7ae23d)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:29.683051 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a42c6f-556c-41a0-b6f3-f1a54baa5f67 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:29.731787 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eed935-d2fe-46b7-b332-8efd50fdd471 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:29.780153 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f3ab00-7039-4d6d-90be-00478952c849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:29.781141 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f3ab00-7039-4d6d-90be-00478952c849 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:29.781623 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f3ab00-7039-4d6d-90be-00478952c849 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:29.782139 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f3ab00-7039-4d6d-90be-00478952c849 None admin] PATH_INFO: `/v3/roles` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:29.782998 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f3ab00-7039-4d6d-90be-00478952c849 None admin] RBAC: Adding query filter params (name=member) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:27:29.783501 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f3ab00-7039-4d6d-90be-00478952c849 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:29.783601 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 69/133] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Aug 18 19:27:29 2022] PUT /identity/v3/projects/84c3b97bc50848039730cfaab66f74f9/users/10bd00684b524d61b436781e07111a43/roles/629bead347a8449ebece758b5a7ae23d => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 19:27:29.786119 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f3ab00-7039-4d6d-90be-00478952c849 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:29.802575 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 65/134] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Aug 18 19:27:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:27:29.808606 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a42c6f-556c-41a0-b6f3-f1a54baa5f67 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:29.832728 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:29.946707 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a42c6f-556c-41a0-b6f3-f1a54baa5f67 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:29.989379 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92508452-dc63-46fd-9f16-01190d79495f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:29.990075 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92508452-dc63-46fd-9f16-01190d79495f None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:29.990461 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92508452-dc63-46fd-9f16-01190d79495f None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:29.990742 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92508452-dc63-46fd-9f16-01190d79495f None admin] PATH_INFO: `/v3/users/10bd00684b524d61b436781e07111a43` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:29.991928 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92508452-dc63-46fd-9f16-01190d79495f None admin] RBAC: Authorizing `identity:get_user(user_id=10bd00684b524d61b436781e07111a43)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:29.993687 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92508452-dc63-46fd-9f16-01190d79495f None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:29.995396 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 70/135] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Aug 18 19:27:29 2022] GET /identity/v3/users/10bd00684b524d61b436781e07111a43 => generated 275 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:27:30.001175 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f3ab00-7039-4d6d-90be-00478952c849 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:30.010782 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:30.157867 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f3ab00-7039-4d6d-90be-00478952c849 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:30.205149 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6861e16b-1992-4703-b2af-4b47045db163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:30.206329 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6861e16b-1992-4703-b2af-4b47045db163 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:30.206622 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6861e16b-1992-4703-b2af-4b47045db163 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:30.206903 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6861e16b-1992-4703-b2af-4b47045db163 None admin] PATH_INFO: `/v3/projects/53d8edf14381441f925c723e97ecf41b` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:30.208109 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6861e16b-1992-4703-b2af-4b47045db163 None admin] RBAC: Authorizing `identity:get_project(project_id=53d8edf14381441f925c723e97ecf41b)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:30.209611 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6861e16b-1992-4703-b2af-4b47045db163 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:30.211673 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 66/136] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Aug 18 19:27:30 2022] GET /identity/v3/projects/53d8edf14381441f925c723e97ecf41b => generated 312 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:27:30.217878 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92508452-dc63-46fd-9f16-01190d79495f None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:30.329118 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:30.351521 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92508452-dc63-46fd-9f16-01190d79495f None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:30.373635 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941f76c5-6991-4381-8bea-265000ddb5e2 None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:30.374012 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941f76c5-6991-4381-8bea-265000ddb5e2 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:30.374233 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941f76c5-6991-4381-8bea-265000ddb5e2 None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:30.375705 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 67/137] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:27:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 19:27:30.382328 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb307b6-5127-4ae6-8064-6eaf0171c8ee None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:30.383605 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb307b6-5127-4ae6-8064-6eaf0171c8ee None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:30.383893 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb307b6-5127-4ae6-8064-6eaf0171c8ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:30.403996 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2002c55-9796-4067-9764-df47c671feb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:30.404683 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2002c55-9796-4067-9764-df47c671feb6 None admin] REQUEST_METHOD: `PUT` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:30.404962 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2002c55-9796-4067-9764-df47c671feb6 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:30.405237 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2002c55-9796-4067-9764-df47c671feb6 None admin] PATH_INFO: `/v3/projects/53d8edf14381441f925c723e97ecf41b/users/10bd00684b524d61b436781e07111a43/roles/ece5eb2bd1334192b3eee1b7b05c042c` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:30.407387 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2002c55-9796-4067-9764-df47c671feb6 None admin] RBAC: Authorizing `identity:create_grant(project_id=53d8edf14381441f925c723e97ecf41b, user_id=10bd00684b524d61b436781e07111a43, role_id=ece5eb2bd1334192b3eee1b7b05c042c)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:30.409367 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2002c55-9796-4067-9764-df47c671feb6 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:30.413970 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-fcb307b6-5127-4ae6-8064-6eaf0171c8ee None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:27:30.415197 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-fcb307b6-5127-4ae6-8064-6eaf0171c8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:27:30.481900 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 71/138] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Aug 18 19:27:30 2022] PUT /identity/v3/projects/53d8edf14381441f925c723e97ecf41b/users/10bd00684b524d61b436781e07111a43/roles/ece5eb2bd1334192b3eee1b7b05c042c => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 19:27:30.556909 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 68/139] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:27:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:27:31.081868 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2002c55-9796-4067-9764-df47c671feb6 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:31.198669 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2002c55-9796-4067-9764-df47c671feb6 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:31.243594 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed06f2dc-fd05-43ea-9fbb-6dd46fc59265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:31.244226 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed06f2dc-fd05-43ea-9fbb-6dd46fc59265 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:31.244631 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed06f2dc-fd05-43ea-9fbb-6dd46fc59265 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:31.244904 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed06f2dc-fd05-43ea-9fbb-6dd46fc59265 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:31.246034 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed06f2dc-fd05-43ea-9fbb-6dd46fc59265 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:31.247470 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed06f2dc-fd05-43ea-9fbb-6dd46fc59265 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:31.255459 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 72/140] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Aug 18 19:27:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:27:31.261016 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb307b6-5127-4ae6-8064-6eaf0171c8ee None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:31.264467 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:31.378764 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb307b6-5127-4ae6-8064-6eaf0171c8ee None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:31.420803 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5403512c-d15a-4f84-b299-a5ce575d159d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:31.421415 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5403512c-d15a-4f84-b299-a5ce575d159d None admin] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:31.421716 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5403512c-d15a-4f84-b299-a5ce575d159d None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:31.422036 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5403512c-d15a-4f84-b299-a5ce575d159d None admin] PATH_INFO: `/v3/users` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:31.422679 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5403512c-d15a-4f84-b299-a5ce575d159d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:31.424123 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5403512c-d15a-4f84-b299-a5ce575d159d None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:31.532228 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 69/141] 10.222.0.23 () {60 vars in 1132 bytes} [Thu Aug 18 19:27:31 2022] POST /identity/v3/users => generated 283 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 19:27:31.671754 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb2a2cf-5c26-45a9-a717-d62ce856c51e None None] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:31.672092 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb2a2cf-5c26-45a9-a717-d62ce856c51e None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:31.672309 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb2a2cf-5c26-45a9-a717-d62ce856c51e None None] PATH_INFO: `/` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:31.673919 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 73/142] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:27:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:27:31.679611 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3732c0-8834-4afb-bdc9-645bcc327afc None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:31.679926 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3732c0-8834-4afb-bdc9-645bcc327afc None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:31.680181 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3732c0-8834-4afb-bdc9-645bcc327afc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:31.698940 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-5d3732c0-8834-4afb-bdc9-645bcc327afc None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:27:31.700147 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-5d3732c0-8834-4afb-bdc9-645bcc327afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:27:31.776164 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:31.791105 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 70/143] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:27:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:27:31.851796 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c60d85e-cd07-45d8-8a02-1f20a0ec8514 None None] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:31.852111 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c60d85e-cd07-45d8-8a02-1f20a0ec8514 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:31.852352 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c60d85e-cd07-45d8-8a02-1f20a0ec8514 None None] PATH_INFO: `/` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:31.853721 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 74/144] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:27:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:27:31.859026 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71417959-8000-42e9-a903-d2e6bc18af9b None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:31.859316 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71417959-8000-42e9-a903-d2e6bc18af9b None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:31.859593 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71417959-8000-42e9-a903-d2e6bc18af9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:31.878973 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-71417959-8000-42e9-a903-d2e6bc18af9b None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:27:31.880174 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-71417959-8000-42e9-a903-d2e6bc18af9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:27:31.952057 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 71/145] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:27:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:27:32.305088 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c60d85e-cd07-45d8-8a02-1f20a0ec8514 None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:32.321173 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:32.387731 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71417959-8000-42e9-a903-d2e6bc18af9b None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:32.434632 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c60d85e-cd07-45d8-8a02-1f20a0ec8514 None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:32.477408 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f9e057-363f-47fd-8252-8845e17d9263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:32.478071 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f9e057-363f-47fd-8252-8845e17d9263 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:32.478348 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f9e057-363f-47fd-8252-8845e17d9263 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:32.478622 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f9e057-363f-47fd-8252-8845e17d9263 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:32.493148 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f9e057-363f-47fd-8252-8845e17d9263 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:27:32.498811 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application [None req-78f9e057-363f-47fd-8252-8845e17d9263 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 19:27:32.498811 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:27:32.498811 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:27:32.498811 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:27:32.498811 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:27:32.498811 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:27:32.498811 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:27:32.498811 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:27:32.498811 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:27:32.498811 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:27:32.498811 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:27:32.498811 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:27:32.498811 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:27:32.498811 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:27:32.498811 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:27:32.498811 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:27:32.499765 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:27:32.499765 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:27:32.499765 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:27:32.499765 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:27:32.499765 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:27:32.499765 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:27:32.499765 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:27:32.499765 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:27:32.499765 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:27:32.499765 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:27:32.499765 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:27:32.499765 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application with Lock( Aug 18 19:27:32.499765 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:27:32.499765 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:27:32.499765 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:27:32.499765 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:27:32.500568 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:27:32.500568 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:27:32.500568 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:27:32.500568 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:27:32.500568 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:27:32.500568 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:27:32.500568 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:27:32.500568 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:27:32.500568 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:27:32.500568 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:27:32.500568 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 19:27:32.500568 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:27:32.500568 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 75/146] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Aug 18 19:27:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:27:32.507274 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f9e057-363f-47fd-8252-8845e17d9263 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:32.587934 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71417959-8000-42e9-a903-d2e6bc18af9b None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:32.599092 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:32.625504 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:32.666997 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce2228a-a4b1-4a35-855c-c120fb918d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:32.667660 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce2228a-a4b1-4a35-855c-c120fb918d1e None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:32.667945 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce2228a-a4b1-4a35-855c-c120fb918d1e None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:32.668222 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce2228a-a4b1-4a35-855c-c120fb918d1e None admin] PATH_INFO: `/v3/roles/member` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:32.673305 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f9e057-363f-47fd-8252-8845e17d9263 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:32.692011 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce2228a-a4b1-4a35-855c-c120fb918d1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:27:32.699117 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application [None req-dce2228a-a4b1-4a35-855c-c120fb918d1e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 19:27:32.699117 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:27:32.699117 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:27:32.699117 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:27:32.699117 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:27:32.699117 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:27:32.699117 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:27:32.699117 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:27:32.699117 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:27:32.699117 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:27:32.699117 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:27:32.699117 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:27:32.699117 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:27:32.699117 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:27:32.699117 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:27:32.699117 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:27:32.699997 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:27:32.699997 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:27:32.699997 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:27:32.699997 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:27:32.699997 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:27:32.699997 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:27:32.699997 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:27:32.699997 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:27:32.699997 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:27:32.699997 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:27:32.699997 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:27:32.699997 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application with Lock( Aug 18 19:27:32.699997 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:27:32.699997 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:27:32.699997 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:27:32.699997 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:27:32.700770 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:27:32.700770 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:27:32.700770 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:27:32.700770 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:27:32.700770 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:27:32.700770 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:27:32.700770 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:27:32.700770 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:27:32.700770 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:27:32.700770 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:27:32.700770 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 19:27:32.700770 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:27:32.700770 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 72/147] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Aug 18 19:27:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:27:32.707778 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce2228a-a4b1-4a35-855c-c120fb918d1e None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:32.728861 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d241a7-3c54-4459-a065-0c431800168f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:32.729485 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d241a7-3c54-4459-a065-0c431800168f None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:32.729791 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d241a7-3c54-4459-a065-0c431800168f None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:32.730065 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d241a7-3c54-4459-a065-0c431800168f None admin] PATH_INFO: `/v3/roles` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:32.730739 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d241a7-3c54-4459-a065-0c431800168f None admin] RBAC: Adding query filter params (name=reader) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:27:32.731073 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d241a7-3c54-4459-a065-0c431800168f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:32.732638 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d241a7-3c54-4459-a065-0c431800168f None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:32.746511 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 76/148] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Aug 18 19:27:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:27:32.752435 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d241a7-3c54-4459-a065-0c431800168f None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:32.826429 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce2228a-a4b1-4a35-855c-c120fb918d1e None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:32.866128 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734f2077-bb0a-4224-bad5-d04a32729668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:32.866677 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734f2077-bb0a-4224-bad5-d04a32729668 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:32.866960 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734f2077-bb0a-4224-bad5-d04a32729668 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:32.867236 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734f2077-bb0a-4224-bad5-d04a32729668 None admin] PATH_INFO: `/v3/roles` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:32.868006 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734f2077-bb0a-4224-bad5-d04a32729668 None admin] RBAC: Adding query filter params (name=member) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:27:32.868314 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734f2077-bb0a-4224-bad5-d04a32729668 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:32.869965 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734f2077-bb0a-4224-bad5-d04a32729668 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:32.879907 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 73/149] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Aug 18 19:27:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:27:32.885756 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734f2077-bb0a-4224-bad5-d04a32729668 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:32.903115 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d241a7-3c54-4459-a065-0c431800168f None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:32.931781 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:32.956254 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:32.965245 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d8ab9c-7fe4-4a37-8c4e-a8e50e381145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:32.966572 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d8ab9c-7fe4-4a37-8c4e-a8e50e381145 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:32.967157 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d8ab9c-7fe4-4a37-8c4e-a8e50e381145 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:32.967440 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d8ab9c-7fe4-4a37-8c4e-a8e50e381145 None admin] PATH_INFO: `/v3/users/99e51f0d1fad49f3a25eacec953f0008` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:32.968619 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d8ab9c-7fe4-4a37-8c4e-a8e50e381145 None admin] RBAC: Authorizing `identity:get_user(user_id=99e51f0d1fad49f3a25eacec953f0008)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:32.974362 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d8ab9c-7fe4-4a37-8c4e-a8e50e381145 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:32.976583 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 77/150] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Aug 18 19:27:32 2022] GET /identity/v3/users/99e51f0d1fad49f3a25eacec953f0008 => generated 289 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:27:32.982446 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d8ab9c-7fe4-4a37-8c4e-a8e50e381145 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:33.010177 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734f2077-bb0a-4224-bad5-d04a32729668 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:33.065413 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24acfb32-c549-49dd-b538-84378656c654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:33.070799 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24acfb32-c549-49dd-b538-84378656c654 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:33.071180 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24acfb32-c549-49dd-b538-84378656c654 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:33.071462 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24acfb32-c549-49dd-b538-84378656c654 None admin] PATH_INFO: `/v3/users/10bd00684b524d61b436781e07111a43` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:33.072777 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24acfb32-c549-49dd-b538-84378656c654 None admin] RBAC: Authorizing `identity:get_user(user_id=10bd00684b524d61b436781e07111a43)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:33.074387 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24acfb32-c549-49dd-b538-84378656c654 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:33.076235 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 74/151] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Aug 18 19:27:32 2022] GET /identity/v3/users/10bd00684b524d61b436781e07111a43 => generated 275 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:27:33.082723 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24acfb32-c549-49dd-b538-84378656c654 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:33.159354 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d8ab9c-7fe4-4a37-8c4e-a8e50e381145 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:33.216888 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88747aaa-7366-4057-a0f8-21ef97633c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:33.217936 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88747aaa-7366-4057-a0f8-21ef97633c0e None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:33.218430 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88747aaa-7366-4057-a0f8-21ef97633c0e None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:33.218909 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88747aaa-7366-4057-a0f8-21ef97633c0e None admin] PATH_INFO: `/v3/projects/84c3b97bc50848039730cfaab66f74f9` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:33.220261 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88747aaa-7366-4057-a0f8-21ef97633c0e None admin] RBAC: Authorizing `identity:get_project(project_id=84c3b97bc50848039730cfaab66f74f9)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:33.222493 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88747aaa-7366-4057-a0f8-21ef97633c0e None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:33.230093 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 78/152] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Aug 18 19:27:32 2022] GET /identity/v3/projects/84c3b97bc50848039730cfaab66f74f9 => generated 298 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:27:33.232440 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24acfb32-c549-49dd-b538-84378656c654 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:33.235745 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88747aaa-7366-4057-a0f8-21ef97633c0e None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:33.251755 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:33.297931 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54971c8d-4cc1-4c88-af01-fe2dfeffa6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:33.301842 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54971c8d-4cc1-4c88-af01-fe2dfeffa6d7 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:33.301842 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54971c8d-4cc1-4c88-af01-fe2dfeffa6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:33.301842 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54971c8d-4cc1-4c88-af01-fe2dfeffa6d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:33.354048 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:33.408326 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88747aaa-7366-4057-a0f8-21ef97633c0e None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:33.418478 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54971c8d-4cc1-4c88-af01-fe2dfeffa6d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:33.419880 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54971c8d-4cc1-4c88-af01-fe2dfeffa6d7 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:33.479141 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aa43b2-7b86-4a61-a6d4-04409f1cb3ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:33.479817 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aa43b2-7b86-4a61-a6d4-04409f1cb3ba None admin] REQUEST_METHOD: `PUT` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:33.482048 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aa43b2-7b86-4a61-a6d4-04409f1cb3ba None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:33.482335 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aa43b2-7b86-4a61-a6d4-04409f1cb3ba None admin] PATH_INFO: `/v3/projects/84c3b97bc50848039730cfaab66f74f9/users/99e51f0d1fad49f3a25eacec953f0008/roles/9aa2d4ac6d7540c68a34e8ffba0e545d` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:33.485316 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aa43b2-7b86-4a61-a6d4-04409f1cb3ba None admin] RBAC: Authorizing `identity:create_grant(project_id=84c3b97bc50848039730cfaab66f74f9, user_id=99e51f0d1fad49f3a25eacec953f0008, role_id=9aa2d4ac6d7540c68a34e8ffba0e545d)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:33.486875 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aa43b2-7b86-4a61-a6d4-04409f1cb3ba None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:33.568070 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 75/153] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Aug 18 19:27:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 18 19:27:33.569421 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36607ad-c057-420f-896d-d0aefc0750a1 None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:33.570069 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36607ad-c057-420f-896d-d0aefc0750a1 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:33.570352 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36607ad-c057-420f-896d-d0aefc0750a1 None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:33.571803 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 76/154] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:27:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:27:33.573065 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42938b8-f048-4605-87b3-fb2b00d1eba8 None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:33.573402 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42938b8-f048-4605-87b3-fb2b00d1eba8 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:33.573721 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42938b8-f048-4605-87b3-fb2b00d1eba8 None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:33.575201 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 77/155] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:27:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:27:33.575314 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 79/156] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Aug 18 19:27:33 2022] PUT /identity/v3/projects/84c3b97bc50848039730cfaab66f74f9/users/99e51f0d1fad49f3a25eacec953f0008/roles/9aa2d4ac6d7540c68a34e8ffba0e545d => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 19:27:33.586861 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42938b8-f048-4605-87b3-fb2b00d1eba8 None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:33.589840 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4025cc9-1b8a-4366-b729-0b7d10f3b471 None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:33.590323 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4025cc9-1b8a-4366-b729-0b7d10f3b471 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:33.590605 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4025cc9-1b8a-4366-b729-0b7d10f3b471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:33.604136 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:33.620369 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-b4025cc9-1b8a-4366-b729-0b7d10f3b471 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:27:33.625702 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-b4025cc9-1b8a-4366-b729-0b7d10f3b471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:27:33.749674 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 80/157] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:27:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:27:33.751551 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45309b3-826f-4883-9a2b-1200fe1a2e58 None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:33.751983 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45309b3-826f-4883-9a2b-1200fe1a2e58 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:33.752448 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45309b3-826f-4883-9a2b-1200fe1a2e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:33.772402 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42938b8-f048-4605-87b3-fb2b00d1eba8 None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:33.782509 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-f45309b3-826f-4883-9a2b-1200fe1a2e58 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:27:33.784529 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-f45309b3-826f-4883-9a2b-1200fe1a2e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:27:33.883487 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:33.886493 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161f8ce1-1010-46ba-b748-cf7aa5c0b6ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:33.887160 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161f8ce1-1010-46ba-b748-cf7aa5c0b6ca None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:33.887444 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161f8ce1-1010-46ba-b748-cf7aa5c0b6ca None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:33.887719 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161f8ce1-1010-46ba-b748-cf7aa5c0b6ca None admin] PATH_INFO: `/v3/projects/84c3b97bc50848039730cfaab66f74f9` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:33.888957 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161f8ce1-1010-46ba-b748-cf7aa5c0b6ca None admin] RBAC: Authorizing `identity:get_project(project_id=84c3b97bc50848039730cfaab66f74f9)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:33.890439 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161f8ce1-1010-46ba-b748-cf7aa5c0b6ca None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:33.894823 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 78/158] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Aug 18 19:27:33 2022] GET /identity/v3/projects/84c3b97bc50848039730cfaab66f74f9 => generated 298 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:27:33.903570 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161f8ce1-1010-46ba-b748-cf7aa5c0b6ca None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:33.909776 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 81/159] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:27:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:27:34.022713 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:34.048775 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161f8ce1-1010-46ba-b748-cf7aa5c0b6ca None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:34.137863 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65ce300-edf0-4a5c-bfc7-7f26f86058f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:34.138487 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ce300-edf0-4a5c-bfc7-7f26f86058f9 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:34.138767 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ce300-edf0-4a5c-bfc7-7f26f86058f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:34.139040 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ce300-edf0-4a5c-bfc7-7f26f86058f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:34.139771 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65ce300-edf0-4a5c-bfc7-7f26f86058f9 None admin] RBAC: Adding query filter params (role.id=ece5eb2bd1334192b3eee1b7b05c042c, scope.project.id=84c3b97bc50848039730cfaab66f74f9, user.id=10bd00684b524d61b436781e07111a43) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:27:34.140081 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65ce300-edf0-4a5c-bfc7-7f26f86058f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:34.141547 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65ce300-edf0-4a5c-bfc7-7f26f86058f9 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:34.150288 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 79/160] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Aug 18 19:27:33 2022] GET /identity/v3/role_assignments?user.id=10bd00684b524d61b436781e07111a43&scope.project.id=84c3b97bc50848039730cfaab66f74f9&role.id=ece5eb2bd1334192b3eee1b7b05c042c => generated 608 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:27:34.442186 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45309b3-826f-4883-9a2b-1200fe1a2e58 None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:34.516225 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f8fcac-398e-48b1-9951-29026bc94efd None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:34.516225 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f8fcac-398e-48b1-9951-29026bc94efd None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:34.516225 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f8fcac-398e-48b1-9951-29026bc94efd None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:34.516225 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 80/161] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:27:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:27:34.524115 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8e9441-ef22-436e-9966-0792fa34530a None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:34.524708 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8e9441-ef22-436e-9966-0792fa34530a None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:34.525217 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8e9441-ef22-436e-9966-0792fa34530a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:34.551361 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-ff8e9441-ef22-436e-9966-0792fa34530a None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:27:34.553832 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-ff8e9441-ef22-436e-9966-0792fa34530a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:27:34.589572 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45309b3-826f-4883-9a2b-1200fe1a2e58 None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:34.638023 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 81/162] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:27:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:27:34.669162 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c797c4b-a880-4a3c-8fa8-3c7dae3dfa3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:34.669838 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c797c4b-a880-4a3c-8fa8-3c7dae3dfa3d None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:34.670121 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c797c4b-a880-4a3c-8fa8-3c7dae3dfa3d None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:34.670395 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c797c4b-a880-4a3c-8fa8-3c7dae3dfa3d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:34.690611 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c797c4b-a880-4a3c-8fa8-3c7dae3dfa3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:27:34.695577 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application [None req-4c797c4b-a880-4a3c-8fa8-3c7dae3dfa3d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 19:27:34.695577 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:27:34.695577 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:27:34.695577 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:27:34.695577 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:27:34.695577 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:27:34.695577 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:27:34.695577 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:27:34.695577 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:27:34.695577 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:27:34.695577 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:27:34.695577 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:27:34.695577 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:27:34.695577 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:27:34.695577 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:27:34.695577 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:27:34.696487 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:27:34.696487 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:27:34.696487 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:27:34.696487 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:27:34.696487 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:27:34.696487 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:27:34.696487 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:27:34.696487 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:27:34.696487 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:27:34.696487 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:27:34.696487 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:27:34.696487 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application with Lock( Aug 18 19:27:34.696487 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:27:34.696487 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:27:34.696487 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:27:34.696487 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:27:34.697251 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:27:34.697251 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:27:34.697251 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:27:34.697251 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:27:34.697251 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:27:34.697251 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:27:34.697251 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:27:34.697251 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:27:34.697251 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:27:34.697251 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:27:34.697251 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 19:27:34.697251 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:27:34.699349 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 82/163] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Aug 18 19:27:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:27:34.704236 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8e9441-ef22-436e-9966-0792fa34530a None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:34.710964 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c797c4b-a880-4a3c-8fa8-3c7dae3dfa3d None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:34.809575 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:34.842212 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:34.854330 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8e9441-ef22-436e-9966-0792fa34530a None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:34.907617 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55c8af8-573e-4993-9a91-dd99ec8770fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:34.909300 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c8af8-573e-4993-9a91-dd99ec8770fe None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:34.909822 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c8af8-573e-4993-9a91-dd99ec8770fe None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:34.910302 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c8af8-573e-4993-9a91-dd99ec8770fe None admin] PATH_INFO: `/v3/roles` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:34.911168 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55c8af8-573e-4993-9a91-dd99ec8770fe None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:27:34.911668 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55c8af8-573e-4993-9a91-dd99ec8770fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:34.913222 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55c8af8-573e-4993-9a91-dd99ec8770fe None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:34.927473 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 82/164] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Aug 18 19:27:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:27:34.934606 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55c8af8-573e-4993-9a91-dd99ec8770fe None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:34.999752 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c797c4b-a880-4a3c-8fa8-3c7dae3dfa3d None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:35.066362 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2528ee-20ce-4623-ba84-862951864e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:35.067069 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2528ee-20ce-4623-ba84-862951864e81 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:35.067355 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2528ee-20ce-4623-ba84-862951864e81 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:35.067629 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2528ee-20ce-4623-ba84-862951864e81 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:35.083936 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2528ee-20ce-4623-ba84-862951864e81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:27:35.088961 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application [None req-3a2528ee-20ce-4623-ba84-862951864e81 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 19:27:35.088961 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:27:35.088961 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:27:35.088961 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:27:35.088961 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:27:35.088961 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:27:35.088961 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:27:35.088961 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:27:35.088961 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:27:35.088961 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:27:35.088961 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:27:35.088961 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:27:35.088961 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:27:35.088961 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:27:35.088961 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:27:35.088961 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:27:35.089894 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:27:35.089894 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:27:35.089894 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:27:35.089894 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:27:35.089894 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:27:35.089894 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:27:35.089894 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:27:35.089894 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:27:35.089894 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:27:35.089894 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:27:35.089894 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:27:35.089894 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application with Lock( Aug 18 19:27:35.089894 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:27:35.089894 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:27:35.089894 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:27:35.089894 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:27:35.090659 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:27:35.090659 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:27:35.090659 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:27:35.090659 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:27:35.090659 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:27:35.090659 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:27:35.090659 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:27:35.090659 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:27:35.090659 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:27:35.090659 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:27:35.090659 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 19:27:35.090659 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:27:35.098189 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 83/165] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Aug 18 19:27:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 388 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 19:27:35.104024 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2528ee-20ce-4623-ba84-862951864e81 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:35.163708 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55c8af8-573e-4993-9a91-dd99ec8770fe None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:35.215500 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:35.226046 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db35a9b-c0bd-4f61-a905-8472ed222aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:35.227675 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db35a9b-c0bd-4f61-a905-8472ed222aa3 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:35.227675 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db35a9b-c0bd-4f61-a905-8472ed222aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:35.227675 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db35a9b-c0bd-4f61-a905-8472ed222aa3 None admin] PATH_INFO: `/v3/users/10bd00684b524d61b436781e07111a43` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:35.230265 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db35a9b-c0bd-4f61-a905-8472ed222aa3 None admin] RBAC: Authorizing `identity:get_user(user_id=10bd00684b524d61b436781e07111a43)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:35.231710 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db35a9b-c0bd-4f61-a905-8472ed222aa3 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:35.233396 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 83/166] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Aug 18 19:27:34 2022] GET /identity/v3/users/10bd00684b524d61b436781e07111a43 => generated 275 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:27:35.242826 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db35a9b-c0bd-4f61-a905-8472ed222aa3 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:35.249686 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2528ee-20ce-4623-ba84-862951864e81 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:35.264890 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:35.342967 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fac433-82ce-4f22-b6fa-9c2b9d8b1946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:35.343665 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fac433-82ce-4f22-b6fa-9c2b9d8b1946 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:35.343854 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fac433-82ce-4f22-b6fa-9c2b9d8b1946 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:35.344130 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fac433-82ce-4f22-b6fa-9c2b9d8b1946 None admin] PATH_INFO: `/v3/roles` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:35.344800 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fac433-82ce-4f22-b6fa-9c2b9d8b1946 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:27:35.345101 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fac433-82ce-4f22-b6fa-9c2b9d8b1946 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:35.346563 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fac433-82ce-4f22-b6fa-9c2b9d8b1946 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:35.368823 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db35a9b-c0bd-4f61-a905-8472ed222aa3 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:35.375530 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 84/167] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Aug 18 19:27:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:27:35.376462 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fac433-82ce-4f22-b6fa-9c2b9d8b1946 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:35.408180 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6336efb2-c115-4452-9c31-e9adfebdea51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:35.409193 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6336efb2-c115-4452-9c31-e9adfebdea51 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:35.409739 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6336efb2-c115-4452-9c31-e9adfebdea51 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:35.410301 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6336efb2-c115-4452-9c31-e9adfebdea51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:35.487616 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6336efb2-c115-4452-9c31-e9adfebdea51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:35.489418 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6336efb2-c115-4452-9c31-e9adfebdea51 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:35.492695 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:35.623438 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fac433-82ce-4f22-b6fa-9c2b9d8b1946 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:35.688966 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 84/168] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Aug 18 19:27:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 18 19:27:35.695518 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6336efb2-c115-4452-9c31-e9adfebdea51 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:35.697308 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdd1fbf-f7d0-428c-b843-ac0060c21299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:35.699972 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdd1fbf-f7d0-428c-b843-ac0060c21299 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:35.700469 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdd1fbf-f7d0-428c-b843-ac0060c21299 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:35.700931 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdd1fbf-f7d0-428c-b843-ac0060c21299 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:35.721950 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdd1fbf-f7d0-428c-b843-ac0060c21299 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:27:35.728371 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application [None req-ebdd1fbf-f7d0-428c-b843-ac0060c21299 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 19:27:35.728371 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:27:35.728371 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:27:35.728371 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:27:35.728371 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:27:35.728371 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:27:35.728371 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:27:35.728371 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:27:35.728371 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:27:35.728371 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:27:35.728371 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:27:35.728371 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:27:35.728371 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:27:35.728371 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:27:35.728371 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:27:35.728371 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:27:35.729252 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:27:35.729252 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:27:35.729252 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:27:35.729252 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:27:35.729252 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:27:35.729252 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:27:35.729252 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:27:35.729252 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:27:35.729252 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:27:35.729252 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:27:35.729252 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:27:35.729252 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application with Lock( Aug 18 19:27:35.729252 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:27:35.729252 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:27:35.729252 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:27:35.729252 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:27:35.730060 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:27:35.730060 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:27:35.730060 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:27:35.730060 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:27:35.730060 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:27:35.730060 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:27:35.730060 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:27:35.730060 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:27:35.730060 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:27:35.730060 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:27:35.730060 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 19:27:35.730060 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:27:35.738593 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 85/169] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Aug 18 19:27:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 363 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:27:35.746968 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdd1fbf-f7d0-428c-b843-ac0060c21299 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:35.810726 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:35.906941 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:35.910950 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6336efb2-c115-4452-9c31-e9adfebdea51 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:35.937507 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdd1fbf-f7d0-428c-b843-ac0060c21299 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:35.981832 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf539a3-5d16-4bd2-99cd-130932493b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:35.982762 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf539a3-5d16-4bd2-99cd-130932493b95 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:35.983209 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf539a3-5d16-4bd2-99cd-130932493b95 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:35.983871 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf539a3-5d16-4bd2-99cd-130932493b95 None admin] PATH_INFO: `/v3/users/f765ddb0f75b40179001f4a64546ab53` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:35.985980 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf539a3-5d16-4bd2-99cd-130932493b95 None admin] RBAC: Authorizing `identity:get_user(user_id=f765ddb0f75b40179001f4a64546ab53)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:35.988676 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf539a3-5d16-4bd2-99cd-130932493b95 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:35.990596 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 85/170] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Aug 18 19:27:35 2022] GET /identity/v3/users/f765ddb0f75b40179001f4a64546ab53 => generated 247 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:27:35.991688 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf539a3-5d16-4bd2-99cd-130932493b95 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:36.012372 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6320b9b2-0408-4c7f-8c72-3b9f63c20c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:36.013326 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6320b9b2-0408-4c7f-8c72-3b9f63c20c59 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:36.013812 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6320b9b2-0408-4c7f-8c72-3b9f63c20c59 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:36.014250 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6320b9b2-0408-4c7f-8c72-3b9f63c20c59 None admin] PATH_INFO: `/v3/projects/84c3b97bc50848039730cfaab66f74f9` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:36.015585 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6320b9b2-0408-4c7f-8c72-3b9f63c20c59 None admin] RBAC: Authorizing `identity:get_project(project_id=84c3b97bc50848039730cfaab66f74f9)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:36.018007 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6320b9b2-0408-4c7f-8c72-3b9f63c20c59 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:36.023903 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 86/171] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Aug 18 19:27:35 2022] GET /identity/v3/projects/84c3b97bc50848039730cfaab66f74f9 => generated 298 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:27:36.024880 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6320b9b2-0408-4c7f-8c72-3b9f63c20c59 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:36.124380 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf539a3-5d16-4bd2-99cd-130932493b95 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:36.193630 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79734865-197b-4c39-bec2-93ee54dd100b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:36.194640 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79734865-197b-4c39-bec2-93ee54dd100b None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:36.196050 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79734865-197b-4c39-bec2-93ee54dd100b None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:36.196462 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79734865-197b-4c39-bec2-93ee54dd100b None admin] PATH_INFO: `/v3/roles` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:36.198276 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79734865-197b-4c39-bec2-93ee54dd100b None admin] RBAC: Adding query filter params (name=member) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:27:36.198885 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79734865-197b-4c39-bec2-93ee54dd100b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:36.201553 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79734865-197b-4c39-bec2-93ee54dd100b None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:36.220625 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 86/172] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Aug 18 19:27:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:27:36.223301 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79734865-197b-4c39-bec2-93ee54dd100b None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:36.269142 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:36.274849 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6320b9b2-0408-4c7f-8c72-3b9f63c20c59 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:36.292973 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:36.334600 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b8c76e-783a-4c7d-8e6b-828f941cb1d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:36.335223 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8c76e-783a-4c7d-8e6b-828f941cb1d1 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:36.335502 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8c76e-783a-4c7d-8e6b-828f941cb1d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:36.335774 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8c76e-783a-4c7d-8e6b-828f941cb1d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:36.429199 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79734865-197b-4c39-bec2-93ee54dd100b None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:36.442083 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b8c76e-783a-4c7d-8e6b-828f941cb1d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:36.443705 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b8c76e-783a-4c7d-8e6b-828f941cb1d1 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:36.474645 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9d2df3-3830-4422-8eef-645ac2e333d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:36.476627 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9d2df3-3830-4422-8eef-645ac2e333d0 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:36.478214 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9d2df3-3830-4422-8eef-645ac2e333d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:36.478684 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9d2df3-3830-4422-8eef-645ac2e333d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:36.479786 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9d2df3-3830-4422-8eef-645ac2e333d0 None admin] RBAC: Adding query filter params (role.id=629bead347a8449ebece758b5a7ae23d, scope.project.id=84c3b97bc50848039730cfaab66f74f9, user.id=10bd00684b524d61b436781e07111a43) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:27:36.480995 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9d2df3-3830-4422-8eef-645ac2e333d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:36.484524 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9d2df3-3830-4422-8eef-645ac2e333d0 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:36.496981 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 87/173] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Aug 18 19:27:36 2022] GET /identity/v3/role_assignments?user.id=10bd00684b524d61b436781e07111a43&scope.project.id=84c3b97bc50848039730cfaab66f74f9&role.id=629bead347a8449ebece758b5a7ae23d => generated 608 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:27:36.498908 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9d2df3-3830-4422-8eef-645ac2e333d0 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:36.646861 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:36.653475 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 87/174] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Aug 18 19:27:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 629 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 19:27:36.655301 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc3e9aa-47c4-47b8-8ded-e628cd1e7c53 None None] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:36.655902 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc3e9aa-47c4-47b8-8ded-e628cd1e7c53 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:36.656369 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc3e9aa-47c4-47b8-8ded-e628cd1e7c53 None None] PATH_INFO: `/` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:36.658229 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 88/175] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:27:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:27:36.659615 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba70f3a-c697-461f-b531-6abfbef0bda7 None None] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:36.660085 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba70f3a-c697-461f-b531-6abfbef0bda7 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:36.660555 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba70f3a-c697-461f-b531-6abfbef0bda7 None None] PATH_INFO: `/` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:36.662301 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 89/176] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:27:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:27:36.664169 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba70f3a-c697-461f-b531-6abfbef0bda7 None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:36.725719 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:36.743644 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9d2df3-3830-4422-8eef-645ac2e333d0 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:36.803504 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b72842-1c6e-43a8-a178-15ef3a6b8cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:36.804182 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b72842-1c6e-43a8-a178-15ef3a6b8cc2 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:36.804460 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b72842-1c6e-43a8-a178-15ef3a6b8cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:36.804731 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b72842-1c6e-43a8-a178-15ef3a6b8cc2 None admin] PATH_INFO: `/v3/users/10bd00684b524d61b436781e07111a43` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:36.807435 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b72842-1c6e-43a8-a178-15ef3a6b8cc2 None admin] RBAC: Authorizing `identity:get_user(user_id=10bd00684b524d61b436781e07111a43)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:36.807646 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b72842-1c6e-43a8-a178-15ef3a6b8cc2 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:36.810001 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 88/177] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Aug 18 19:27:36 2022] GET /identity/v3/users/10bd00684b524d61b436781e07111a43 => generated 275 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:27:36.811377 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e10e7d-86e0-4af4-943b-fee38c2db3db None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:36.811659 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e10e7d-86e0-4af4-943b-fee38c2db3db None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:36.811932 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e10e7d-86e0-4af4-943b-fee38c2db3db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:36.823127 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba70f3a-c697-461f-b531-6abfbef0bda7 None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:36.838967 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-e5e10e7d-86e0-4af4-943b-fee38c2db3db None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:27:36.840410 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-e5e10e7d-86e0-4af4-943b-fee38c2db3db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:27:36.870561 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c245e1-2b4f-4832-b5d2-9b682cc58e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:36.871745 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c245e1-2b4f-4832-b5d2-9b682cc58e72 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:36.872250 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c245e1-2b4f-4832-b5d2-9b682cc58e72 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:36.872848 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c245e1-2b4f-4832-b5d2-9b682cc58e72 None admin] PATH_INFO: `/v3/projects/84c3b97bc50848039730cfaab66f74f9` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:36.874913 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c245e1-2b4f-4832-b5d2-9b682cc58e72 None admin] RBAC: Authorizing `identity:get_project(project_id=84c3b97bc50848039730cfaab66f74f9)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:36.876842 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c245e1-2b4f-4832-b5d2-9b682cc58e72 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:36.879396 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 90/178] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Aug 18 19:27:36 2022] GET /identity/v3/projects/84c3b97bc50848039730cfaab66f74f9 => generated 298 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:27:36.880964 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71366374-0fa6-4d04-a86a-b8e248d2e309 None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:36.881611 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71366374-0fa6-4d04-a86a-b8e248d2e309 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:36.882094 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71366374-0fa6-4d04-a86a-b8e248d2e309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:36.905622 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-71366374-0fa6-4d04-a86a-b8e248d2e309 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:27:36.907280 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-71366374-0fa6-4d04-a86a-b8e248d2e309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:27:36.933540 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 89/179] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:27:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:27:36.934624 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e10e7d-86e0-4af4-943b-fee38c2db3db None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:36.983372 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:36.993698 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 91/180] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:27:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:27:36.994811 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71366374-0fa6-4d04-a86a-b8e248d2e309 None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:37.050058 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:37.061897 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e10e7d-86e0-4af4-943b-fee38c2db3db None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:37.100498 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded27fb7-ed90-41eb-a8ba-880bce322e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:37.101317 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded27fb7-ed90-41eb-a8ba-880bce322e92 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:37.101432 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded27fb7-ed90-41eb-a8ba-880bce322e92 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:37.101641 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded27fb7-ed90-41eb-a8ba-880bce322e92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:37.123860 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71366374-0fa6-4d04-a86a-b8e248d2e309 None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:37.159867 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da494dd7-d229-4c9d-b8f4-3ca4474ad446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:37.160709 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da494dd7-d229-4c9d-b8f4-3ca4474ad446 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:37.161124 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da494dd7-d229-4c9d-b8f4-3ca4474ad446 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:37.161557 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da494dd7-d229-4c9d-b8f4-3ca4474ad446 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:37.162442 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da494dd7-d229-4c9d-b8f4-3ca4474ad446 None admin] RBAC: Adding query filter params (role.id=33fe6be3baf44b969c8166af5142e0c7, scope.project.id=84c3b97bc50848039730cfaab66f74f9, user.id=f765ddb0f75b40179001f4a64546ab53) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:27:37.162886 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da494dd7-d229-4c9d-b8f4-3ca4474ad446 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:37.164562 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da494dd7-d229-4c9d-b8f4-3ca4474ad446 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:37.170852 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 92/181] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Aug 18 19:27:36 2022] GET /identity/v3/role_assignments?user.id=f765ddb0f75b40179001f4a64546ab53&scope.project.id=84c3b97bc50848039730cfaab66f74f9&role.id=33fe6be3baf44b969c8166af5142e0c7 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:27:37.172177 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b51fc-0e0b-4ef1-9b89-a6b2401ebbfe None None] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:37.172597 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b51fc-0e0b-4ef1-9b89-a6b2401ebbfe None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:37.173050 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b51fc-0e0b-4ef1-9b89-a6b2401ebbfe None None] PATH_INFO: `/` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:37.175036 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 93/182] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:27:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:27:37.183706 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded27fb7-ed90-41eb-a8ba-880bce322e92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:37.185224 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded27fb7-ed90-41eb-a8ba-880bce322e92 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:37.185557 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2104fad-ac9e-4ad9-be9c-c859cc04ca29 None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:37.186005 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2104fad-ac9e-4ad9-be9c-c859cc04ca29 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:37.186468 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2104fad-ac9e-4ad9-be9c-c859cc04ca29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:37.207437 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-b2104fad-ac9e-4ad9-be9c-c859cc04ca29 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:27:37.209033 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-b2104fad-ac9e-4ad9-be9c-c859cc04ca29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:27:37.282853 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:37.310935 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 94/183] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:27:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:27:37.318847 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:37.331228 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 90/184] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Aug 18 19:27:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 19:27:37.337349 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2104fad-ac9e-4ad9-be9c-c859cc04ca29 None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:37.404839 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded27fb7-ed90-41eb-a8ba-880bce322e92 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:37.528413 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2104fad-ac9e-4ad9-be9c-c859cc04ca29 None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:37.569906 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded27fb7-ed90-41eb-a8ba-880bce322e92 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:37.578303 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769059fd-2154-41d4-bf40-69d02026b786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:37.578847 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769059fd-2154-41d4-bf40-69d02026b786 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:37.579200 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769059fd-2154-41d4-bf40-69d02026b786 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:37.579548 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769059fd-2154-41d4-bf40-69d02026b786 None admin] PATH_INFO: `/v3/projects/53d8edf14381441f925c723e97ecf41b` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:37.581682 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769059fd-2154-41d4-bf40-69d02026b786 None admin] RBAC: Authorizing `identity:get_project(project_id=53d8edf14381441f925c723e97ecf41b)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:37.583151 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769059fd-2154-41d4-bf40-69d02026b786 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:37.584869 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 95/185] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Aug 18 19:27:37 2022] GET /identity/v3/projects/53d8edf14381441f925c723e97ecf41b => generated 312 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:27:37.586123 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f6adbf-a761-49be-8c08-64907c17460e None None] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:37.586481 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f6adbf-a761-49be-8c08-64907c17460e None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:37.586823 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f6adbf-a761-49be-8c08-64907c17460e None None] PATH_INFO: `/` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:37.588107 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 96/186] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:27:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:27:37.593168 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f6adbf-a761-49be-8c08-64907c17460e None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:37.611261 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec1dbf6-4687-4146-a94f-8d8dde5bd66a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:37.612148 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec1dbf6-4687-4146-a94f-8d8dde5bd66a None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:37.612506 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec1dbf6-4687-4146-a94f-8d8dde5bd66a None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:37.612851 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec1dbf6-4687-4146-a94f-8d8dde5bd66a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:37.624082 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec1dbf6-4687-4146-a94f-8d8dde5bd66a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:27:37.629403 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application [None req-bec1dbf6-4687-4146-a94f-8d8dde5bd66a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 19:27:37.629403 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:27:37.629403 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:27:37.629403 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:27:37.629403 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:27:37.629403 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:27:37.629403 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:27:37.629403 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:27:37.629403 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:27:37.629403 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:27:37.629403 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:27:37.629403 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:27:37.629403 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:27:37.629403 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:27:37.629403 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:27:37.629403 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:27:37.630333 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:27:37.630333 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:27:37.630333 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:27:37.630333 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:27:37.630333 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:27:37.630333 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:27:37.630333 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:27:37.630333 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:27:37.630333 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:27:37.630333 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:27:37.630333 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:27:37.630333 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application with Lock( Aug 18 19:27:37.630333 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:27:37.630333 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:27:37.630333 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:27:37.630333 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:27:37.631508 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:27:37.631508 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:27:37.631508 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:27:37.631508 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:27:37.631508 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:27:37.631508 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:27:37.631508 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:27:37.631508 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:27:37.631508 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:27:37.631508 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:27:37.631508 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 19:27:37.631508 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:27:37.631508 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 91/187] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Aug 18 19:27:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 19:27:37.632362 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a47668-b893-4456-82e6-6f73d958cfc9 None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:37.632362 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a47668-b893-4456-82e6-6f73d958cfc9 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:37.632705 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a47668-b893-4456-82e6-6f73d958cfc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:37.651849 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-35a47668-b893-4456-82e6-6f73d958cfc9 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:27:37.653051 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-35a47668-b893-4456-82e6-6f73d958cfc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:27:37.666968 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:37.718029 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:37.721214 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f6adbf-a761-49be-8c08-64907c17460e None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:37.737519 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 92/188] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:27:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:27:37.746551 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a47668-b893-4456-82e6-6f73d958cfc9 None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:37.759472 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1723f001-f536-4c2a-bd7e-8211590a2117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:37.760132 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1723f001-f536-4c2a-bd7e-8211590a2117 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:37.760411 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1723f001-f536-4c2a-bd7e-8211590a2117 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:37.760680 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1723f001-f536-4c2a-bd7e-8211590a2117 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:37.761458 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1723f001-f536-4c2a-bd7e-8211590a2117 None admin] RBAC: Adding query filter params (role.id=ece5eb2bd1334192b3eee1b7b05c042c, scope.project.id=53d8edf14381441f925c723e97ecf41b, user.id=10bd00684b524d61b436781e07111a43) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:27:37.761800 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1723f001-f536-4c2a-bd7e-8211590a2117 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:37.763298 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1723f001-f536-4c2a-bd7e-8211590a2117 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:37.777685 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 97/189] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Aug 18 19:27:37 2022] GET /identity/v3/role_assignments?user.id=10bd00684b524d61b436781e07111a43&scope.project.id=53d8edf14381441f925c723e97ecf41b&role.id=ece5eb2bd1334192b3eee1b7b05c042c => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:27:37.777685 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1723f001-f536-4c2a-bd7e-8211590a2117 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:37.882253 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a47668-b893-4456-82e6-6f73d958cfc9 None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:37.905799 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1723f001-f536-4c2a-bd7e-8211590a2117 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:37.921536 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd318ebe-d5be-4a17-bd47-81cb3f2e9257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:37.922216 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd318ebe-d5be-4a17-bd47-81cb3f2e9257 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:37.922497 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd318ebe-d5be-4a17-bd47-81cb3f2e9257 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:37.922769 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd318ebe-d5be-4a17-bd47-81cb3f2e9257 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:37.934430 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:37.935537 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd318ebe-d5be-4a17-bd47-81cb3f2e9257 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:27:37.941552 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application [None req-dd318ebe-d5be-4a17-bd47-81cb3f2e9257 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 19:27:37.941552 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:27:37.941552 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:27:37.941552 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:27:37.941552 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:27:37.941552 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:27:37.941552 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:27:37.941552 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:27:37.941552 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:27:37.941552 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:27:37.941552 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:27:37.941552 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:27:37.941552 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:27:37.941552 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:27:37.941552 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:27:37.941552 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:27:37.948527 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:27:37.948527 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:27:37.948527 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:27:37.948527 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:27:37.948527 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:27:37.948527 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:27:37.948527 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:27:37.948527 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:27:37.948527 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:27:37.948527 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:27:37.948527 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:27:37.948527 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application with Lock( Aug 18 19:27:37.948527 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:27:37.948527 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:27:37.948527 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:27:37.948527 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:27:37.949303 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:27:37.949303 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:27:37.949303 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:27:37.949303 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:27:37.949303 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:27:37.949303 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:27:37.949303 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:27:37.949303 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:27:37.949303 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:27:37.949303 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:27:37.949303 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 19:27:37.949303 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:27:37.949303 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 93/190] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Aug 18 19:27:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:27:37.949303 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd318ebe-d5be-4a17-bd47-81cb3f2e9257 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:37.952821 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd64b01f-a031-405f-b422-c516378b16f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:37.953495 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd64b01f-a031-405f-b422-c516378b16f4 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:37.953815 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd64b01f-a031-405f-b422-c516378b16f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:37.954081 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd64b01f-a031-405f-b422-c516378b16f4 None admin] PATH_INFO: `/v3/roles` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:37.954738 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd64b01f-a031-405f-b422-c516378b16f4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:27:37.955034 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd64b01f-a031-405f-b422-c516378b16f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:37.956454 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd64b01f-a031-405f-b422-c516378b16f4 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:37.970413 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 98/191] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Aug 18 19:27:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:27:37.970928 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd64b01f-a031-405f-b422-c516378b16f4 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:37.996819 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:38.077524 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd318ebe-d5be-4a17-bd47-81cb3f2e9257 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:38.103372 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd64b01f-a031-405f-b422-c516378b16f4 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:38.114298 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52702a57-9003-45df-8f24-28f8e15298b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:38.114697 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52702a57-9003-45df-8f24-28f8e15298b9 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:38.114975 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52702a57-9003-45df-8f24-28f8e15298b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:38.115239 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52702a57-9003-45df-8f24-28f8e15298b9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:38.125214 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52702a57-9003-45df-8f24-28f8e15298b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:27:38.130908 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application [None req-52702a57-9003-45df-8f24-28f8e15298b9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 19:27:38.130908 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:27:38.130908 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:27:38.130908 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:27:38.130908 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:27:38.130908 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:27:38.130908 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:27:38.130908 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:27:38.130908 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:27:38.130908 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:27:38.130908 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:27:38.130908 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:27:38.130908 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:27:38.130908 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:27:38.130908 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:27:38.130908 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:27:38.131778 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:27:38.131778 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:27:38.131778 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:27:38.131778 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:27:38.131778 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:27:38.131778 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:27:38.131778 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:27:38.131778 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:27:38.131778 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:27:38.131778 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:27:38.131778 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:27:38.131778 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application with Lock( Aug 18 19:27:38.131778 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:27:38.131778 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:27:38.131778 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:27:38.131778 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:27:38.132603 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:27:38.132603 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:27:38.132603 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:27:38.132603 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:27:38.132603 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:27:38.132603 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:27:38.132603 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:27:38.132603 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:27:38.132603 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:27:38.132603 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:27:38.132603 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 19:27:38.132603 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:27:38.132603 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 94/192] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Aug 18 19:27:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:27:38.133295 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52702a57-9003-45df-8f24-28f8e15298b9 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:38.139129 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7a3eed-1205-4edd-807c-71cb7107c347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:38.140500 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7a3eed-1205-4edd-807c-71cb7107c347 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:38.140779 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7a3eed-1205-4edd-807c-71cb7107c347 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:38.141051 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7a3eed-1205-4edd-807c-71cb7107c347 None admin] PATH_INFO: `/v3/roles` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:38.141743 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7a3eed-1205-4edd-807c-71cb7107c347 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:27:38.142045 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7a3eed-1205-4edd-807c-71cb7107c347 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:38.143457 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7a3eed-1205-4edd-807c-71cb7107c347 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:38.151500 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 99/193] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Aug 18 19:27:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:27:38.152271 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7a3eed-1205-4edd-807c-71cb7107c347 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:38.197822 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:38.239032 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52702a57-9003-45df-8f24-28f8e15298b9 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:38.240519 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:38.249107 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7a3eed-1205-4edd-807c-71cb7107c347 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:38.273033 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90b3832-2e1c-4533-a9cc-d2ba6c418428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:38.273682 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b3832-2e1c-4533-a9cc-d2ba6c418428 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:38.274025 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b3832-2e1c-4533-a9cc-d2ba6c418428 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:38.274299 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b3832-2e1c-4533-a9cc-d2ba6c418428 None admin] PATH_INFO: `/v3/users/80f1f987a17743e5bf08b3b3141c09eb` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:38.284474 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2817f8f1-044b-4896-a254-8d3cffbf56eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:38.285076 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2817f8f1-044b-4896-a254-8d3cffbf56eb None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:38.285356 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2817f8f1-044b-4896-a254-8d3cffbf56eb None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:38.285624 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2817f8f1-044b-4896-a254-8d3cffbf56eb None admin] PATH_INFO: `/v3/domains/default` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:38.286796 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2817f8f1-044b-4896-a254-8d3cffbf56eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:38.287722 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90b3832-2e1c-4533-a9cc-d2ba6c418428 None admin] RBAC: Authorizing `identity:get_user(user_id=80f1f987a17743e5bf08b3b3141c09eb)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:38.288214 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2817f8f1-044b-4896-a254-8d3cffbf56eb None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:38.289167 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90b3832-2e1c-4533-a9cc-d2ba6c418428 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:38.289784 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 100/194] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Aug 18 19:27:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:27:38.290538 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2817f8f1-044b-4896-a254-8d3cffbf56eb None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:38.290874 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 95/195] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Aug 18 19:27:38 2022] GET /identity/v3/users/80f1f987a17743e5bf08b3b3141c09eb => generated 283 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:27:38.291795 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90b3832-2e1c-4533-a9cc-d2ba6c418428 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:38.389218 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90b3832-2e1c-4533-a9cc-d2ba6c418428 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:38.390400 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2817f8f1-044b-4896-a254-8d3cffbf56eb None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:38.403620 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:38.422887 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8548cb8c-afd2-4f49-a610-aa766532b5ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:38.423141 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923a9b7b-fba9-480d-9e08-716d244d7bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:38.423482 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8548cb8c-afd2-4f49-a610-aa766532b5ce None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:38.423792 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8548cb8c-afd2-4f49-a610-aa766532b5ce None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:38.424402 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a9b7b-fba9-480d-9e08-716d244d7bcd None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:38.424597 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8548cb8c-afd2-4f49-a610-aa766532b5ce None admin] PATH_INFO: `/v3/roles` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:38.424694 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a9b7b-fba9-480d-9e08-716d244d7bcd None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:38.424892 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a9b7b-fba9-480d-9e08-716d244d7bcd None admin] PATH_INFO: `/v3/users/80f1f987a17743e5bf08b3b3141c09eb` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:38.425248 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8548cb8c-afd2-4f49-a610-aa766532b5ce None admin] RBAC: Adding query filter params (name=reader) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:27:38.425550 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8548cb8c-afd2-4f49-a610-aa766532b5ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:38.426066 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923a9b7b-fba9-480d-9e08-716d244d7bcd None admin] RBAC: Authorizing `identity:get_user(user_id=80f1f987a17743e5bf08b3b3141c09eb)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:38.426967 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8548cb8c-afd2-4f49-a610-aa766532b5ce None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:38.427485 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923a9b7b-fba9-480d-9e08-716d244d7bcd None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:38.429051 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 96/196] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Aug 18 19:27:38 2022] GET /identity/v3/users/80f1f987a17743e5bf08b3b3141c09eb => generated 283 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:27:38.429825 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923a9b7b-fba9-480d-9e08-716d244d7bcd None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:38.444422 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 101/197] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Aug 18 19:27:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:27:38.444422 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8548cb8c-afd2-4f49-a610-aa766532b5ce None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:38.458063 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:38.527907 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923a9b7b-fba9-480d-9e08-716d244d7bcd None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:38.537696 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8548cb8c-afd2-4f49-a610-aa766532b5ce None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:38.562893 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70469b3c-ced7-4a40-bbbd-a93880fe9710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:38.563509 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70469b3c-ced7-4a40-bbbd-a93880fe9710 None admin] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:38.563792 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70469b3c-ced7-4a40-bbbd-a93880fe9710 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:38.564075 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70469b3c-ced7-4a40-bbbd-a93880fe9710 None admin] PATH_INFO: `/v3/users` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:38.564722 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70469b3c-ced7-4a40-bbbd-a93880fe9710 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:38.566254 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70469b3c-ced7-4a40-bbbd-a93880fe9710 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:38.571369 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1510b436-3dfa-4d4d-822e-d719aa6f5601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:38.571972 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1510b436-3dfa-4d4d-822e-d719aa6f5601 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:38.572251 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1510b436-3dfa-4d4d-822e-d719aa6f5601 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:38.572525 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1510b436-3dfa-4d4d-822e-d719aa6f5601 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:38.617127 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:38.638921 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1510b436-3dfa-4d4d-822e-d719aa6f5601 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:38.640379 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1510b436-3dfa-4d4d-822e-d719aa6f5601 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:38.685689 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 97/198] 10.222.0.23 () {60 vars in 1132 bytes} [Thu Aug 18 19:27:38 2022] POST /identity/v3/users => generated 297 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 19:27:38.685689 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70469b3c-ced7-4a40-bbbd-a93880fe9710 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:38.752467 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 102/199] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Aug 18 19:27:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 19:27:38.753341 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1510b436-3dfa-4d4d-822e-d719aa6f5601 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:38.777644 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:38.796227 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70469b3c-ced7-4a40-bbbd-a93880fe9710 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:38.834747 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbf93f3-dc42-4a8f-be9f-bca98a17387d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:38.835379 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf93f3-dc42-4a8f-be9f-bca98a17387d None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:38.835658 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf93f3-dc42-4a8f-be9f-bca98a17387d None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:38.835927 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf93f3-dc42-4a8f-be9f-bca98a17387d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:38.851116 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:38.881754 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1510b436-3dfa-4d4d-822e-d719aa6f5601 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:38.920994 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbf93f3-dc42-4a8f-be9f-bca98a17387d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:38.922430 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbf93f3-dc42-4a8f-be9f-bca98a17387d None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:38.926087 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2e38c5-9369-4e52-97d7-33e00a83f887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:38.926720 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e38c5-9369-4e52-97d7-33e00a83f887 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:38.926995 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e38c5-9369-4e52-97d7-33e00a83f887 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:38.927264 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e38c5-9369-4e52-97d7-33e00a83f887 None admin] PATH_INFO: `/v3/users/99e51f0d1fad49f3a25eacec953f0008` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:38.928472 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2e38c5-9369-4e52-97d7-33e00a83f887 None admin] RBAC: Authorizing `identity:get_user(user_id=99e51f0d1fad49f3a25eacec953f0008)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:38.930131 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2e38c5-9369-4e52-97d7-33e00a83f887 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:38.931900 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 103/200] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Aug 18 19:27:38 2022] GET /identity/v3/users/99e51f0d1fad49f3a25eacec953f0008 => generated 289 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:27:38.932639 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2e38c5-9369-4e52-97d7-33e00a83f887 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:39.037254 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:39.058441 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 98/201] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Aug 18 19:27:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 19:27:39.059154 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2e38c5-9369-4e52-97d7-33e00a83f887 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:39.059265 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbf93f3-dc42-4a8f-be9f-bca98a17387d None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:39.144510 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b18cebc-594a-4ded-ba7c-821fb41f4e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:39.145875 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b18cebc-594a-4ded-ba7c-821fb41f4e8a None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:39.146374 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b18cebc-594a-4ded-ba7c-821fb41f4e8a None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:39.146839 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b18cebc-594a-4ded-ba7c-821fb41f4e8a None admin] PATH_INFO: `/v3/projects/f04621419eb84b00a435d700f145cf48` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:39.149516 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b18cebc-594a-4ded-ba7c-821fb41f4e8a None admin] RBAC: Authorizing `identity:get_project(project_id=f04621419eb84b00a435d700f145cf48)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:39.151256 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b18cebc-594a-4ded-ba7c-821fb41f4e8a None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:39.153166 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 104/202] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Aug 18 19:27:38 2022] GET /identity/v3/projects/f04621419eb84b00a435d700f145cf48 => generated 302 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:27:39.154216 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b18cebc-594a-4ded-ba7c-821fb41f4e8a None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:39.174603 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:39.231469 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbf93f3-dc42-4a8f-be9f-bca98a17387d None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:39.271864 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ef1217-fd9e-4da6-8255-6388e39a489e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:39.273011 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef1217-fd9e-4da6-8255-6388e39a489e None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:39.273583 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef1217-fd9e-4da6-8255-6388e39a489e None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:39.274082 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef1217-fd9e-4da6-8255-6388e39a489e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:39.296328 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b18cebc-594a-4ded-ba7c-821fb41f4e8a None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:39.339914 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:39.342566 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c964fa-4887-4426-be9a-dc0ef52066b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:39.343444 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c964fa-4887-4426-be9a-dc0ef52066b3 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:39.343816 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c964fa-4887-4426-be9a-dc0ef52066b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:39.344165 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c964fa-4887-4426-be9a-dc0ef52066b3 None admin] PATH_INFO: `/v3/projects/f04621419eb84b00a435d700f145cf48` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:39.346646 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c964fa-4887-4426-be9a-dc0ef52066b3 None admin] RBAC: Authorizing `identity:get_project(project_id=f04621419eb84b00a435d700f145cf48)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:39.348615 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c964fa-4887-4426-be9a-dc0ef52066b3 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:39.353436 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 105/203] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Aug 18 19:27:39 2022] GET /identity/v3/projects/f04621419eb84b00a435d700f145cf48 => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:27:39.353436 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c964fa-4887-4426-be9a-dc0ef52066b3 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:39.359455 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ef1217-fd9e-4da6-8255-6388e39a489e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:39.362268 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ef1217-fd9e-4da6-8255-6388e39a489e None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:39.464865 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:39.488934 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 99/204] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Aug 18 19:27:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 19:27:39.488934 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ef1217-fd9e-4da6-8255-6388e39a489e None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:39.490514 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c964fa-4887-4426-be9a-dc0ef52066b3 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:39.530439 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2a1f52-b31e-453f-aff8-eee63a01db76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:39.531053 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a1f52-b31e-453f-aff8-eee63a01db76 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:39.531334 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a1f52-b31e-453f-aff8-eee63a01db76 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:39.531605 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a1f52-b31e-453f-aff8-eee63a01db76 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:39.532394 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2a1f52-b31e-453f-aff8-eee63a01db76 None admin] RBAC: Adding query filter params (role.id=629bead347a8449ebece758b5a7ae23d, scope.project.id=f04621419eb84b00a435d700f145cf48, user.id=80f1f987a17743e5bf08b3b3141c09eb) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:27:39.532698 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2a1f52-b31e-453f-aff8-eee63a01db76 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:39.534859 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2a1f52-b31e-453f-aff8-eee63a01db76 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:39.542628 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 106/205] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Aug 18 19:27:39 2022] GET /identity/v3/role_assignments?user.id=80f1f987a17743e5bf08b3b3141c09eb&scope.project.id=f04621419eb84b00a435d700f145cf48&role.id=629bead347a8449ebece758b5a7ae23d => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:27:39.543203 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2a1f52-b31e-453f-aff8-eee63a01db76 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:39.588127 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:39.608097 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ef1217-fd9e-4da6-8255-6388e39a489e None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:39.646741 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47611108-1c3e-431c-80c3-499e09d71a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:39.647763 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47611108-1c3e-431c-80c3-499e09d71a1f None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:39.648272 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47611108-1c3e-431c-80c3-499e09d71a1f None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:39.648747 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47611108-1c3e-431c-80c3-499e09d71a1f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:39.649717 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47611108-1c3e-431c-80c3-499e09d71a1f None admin] RBAC: Adding query filter params (role.id=33fe6be3baf44b969c8166af5142e0c7, scope.project.id=f04621419eb84b00a435d700f145cf48, user.id=80f1f987a17743e5bf08b3b3141c09eb) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:27:39.650276 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47611108-1c3e-431c-80c3-499e09d71a1f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:39.652036 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47611108-1c3e-431c-80c3-499e09d71a1f None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:39.659282 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 100/206] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Aug 18 19:27:39 2022] GET /identity/v3/role_assignments?user.id=80f1f987a17743e5bf08b3b3141c09eb&scope.project.id=f04621419eb84b00a435d700f145cf48&role.id=33fe6be3baf44b969c8166af5142e0c7 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:27:39.675583 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2a1f52-b31e-453f-aff8-eee63a01db76 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:39.717602 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd0eb69-07cc-491d-ab94-fa868c99c7a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:39.718221 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd0eb69-07cc-491d-ab94-fa868c99c7a0 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:39.718503 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd0eb69-07cc-491d-ab94-fa868c99c7a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:39.718780 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd0eb69-07cc-491d-ab94-fa868c99c7a0 None admin] PATH_INFO: `/v3/projects/84c3b97bc50848039730cfaab66f74f9` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:39.720010 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd0eb69-07cc-491d-ab94-fa868c99c7a0 None admin] RBAC: Authorizing `identity:get_project(project_id=84c3b97bc50848039730cfaab66f74f9)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:39.721767 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd0eb69-07cc-491d-ab94-fa868c99c7a0 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:39.723613 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 107/207] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Aug 18 19:27:39 2022] GET /identity/v3/projects/84c3b97bc50848039730cfaab66f74f9 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:27:39.729610 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47611108-1c3e-431c-80c3-499e09d71a1f None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:39.863993 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47611108-1c3e-431c-80c3-499e09d71a1f None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:39.911323 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68632e1-362e-4953-85f0-d0f090595c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:39.911953 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68632e1-362e-4953-85f0-d0f090595c34 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:39.912229 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68632e1-362e-4953-85f0-d0f090595c34 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:39.912513 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68632e1-362e-4953-85f0-d0f090595c34 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:39.913297 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68632e1-362e-4953-85f0-d0f090595c34 None admin] RBAC: Adding query filter params (role.id=9aa2d4ac6d7540c68a34e8ffba0e545d, scope.project.id=84c3b97bc50848039730cfaab66f74f9, user.id=99e51f0d1fad49f3a25eacec953f0008) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:27:39.913617 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68632e1-362e-4953-85f0-d0f090595c34 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:39.915119 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68632e1-362e-4953-85f0-d0f090595c34 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:39.922424 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 101/208] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Aug 18 19:27:39 2022] GET /identity/v3/role_assignments?user.id=99e51f0d1fad49f3a25eacec953f0008&scope.project.id=84c3b97bc50848039730cfaab66f74f9&role.id=9aa2d4ac6d7540c68a34e8ffba0e545d => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:27:41.221086 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a671d9e3-1822-4f56-9be9-25bfd114a489 None None] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:41.221592 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a671d9e3-1822-4f56-9be9-25bfd114a489 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:41.221706 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a671d9e3-1822-4f56-9be9-25bfd114a489 None None] PATH_INFO: `/` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:41.223288 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 108/209] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:27:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:27:41.228564 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ceb453-f39f-441b-82bd-f048e09ef88b None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:41.229349 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ceb453-f39f-441b-82bd-f048e09ef88b None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:41.229847 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ceb453-f39f-441b-82bd-f048e09ef88b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:41.248150 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-d9ceb453-f39f-441b-82bd-f048e09ef88b None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:27:41.249666 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-d9ceb453-f39f-441b-82bd-f048e09ef88b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:27:41.257561 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fea703-5d94-4e90-a20e-411bff6fa00d None None] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:41.259399 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fea703-5d94-4e90-a20e-411bff6fa00d None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:41.259399 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fea703-5d94-4e90-a20e-411bff6fa00d None None] PATH_INFO: `/` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:41.259572 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 109/210] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:27:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 19:27:41.259639 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:41.267102 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c245a782-8fbb-47fa-8686-24d147fac9ef None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:41.267102 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c245a782-8fbb-47fa-8686-24d147fac9ef None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:41.267102 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c245a782-8fbb-47fa-8686-24d147fac9ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:41.286811 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-c245a782-8fbb-47fa-8686-24d147fac9ef None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:27:41.288306 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-c245a782-8fbb-47fa-8686-24d147fac9ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:27:41.304074 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:41.333851 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 102/211] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:27:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 19:27:41.362991 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 110/212] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:27:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 19:27:41.657678 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ceb453-f39f-441b-82bd-f048e09ef88b None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:41.716221 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c245a782-8fbb-47fa-8686-24d147fac9ef None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:41.764263 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ceb453-f39f-441b-82bd-f048e09ef88b None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:41.800653 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482f9790-7b35-4eab-a2a0-7a32818070bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:41.801755 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f9790-7b35-4eab-a2a0-7a32818070bc None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:41.802232 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f9790-7b35-4eab-a2a0-7a32818070bc None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:41.802696 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f9790-7b35-4eab-a2a0-7a32818070bc None admin] PATH_INFO: `/v3/domains/default` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:41.804081 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482f9790-7b35-4eab-a2a0-7a32818070bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:41.805763 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482f9790-7b35-4eab-a2a0-7a32818070bc None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:41.807546 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 103/213] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Aug 18 19:27:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:27:41.815570 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482f9790-7b35-4eab-a2a0-7a32818070bc None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:41.830959 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:41.840129 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c245a782-8fbb-47fa-8686-24d147fac9ef None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:41.881754 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845ae88d-9c27-41b1-acd6-23b3624954b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:41.882967 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845ae88d-9c27-41b1-acd6-23b3624954b6 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:41.883576 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845ae88d-9c27-41b1-acd6-23b3624954b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:41.884112 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845ae88d-9c27-41b1-acd6-23b3624954b6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:41.896950 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845ae88d-9c27-41b1-acd6-23b3624954b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:27:41.903052 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application [None req-845ae88d-9c27-41b1-acd6-23b3624954b6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 19:27:41.903052 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:27:41.903052 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:27:41.903052 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:27:41.903052 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:27:41.903052 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:27:41.903052 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:27:41.903052 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:27:41.903052 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:27:41.903052 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:27:41.903052 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:27:41.903052 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:27:41.903052 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:27:41.903052 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:27:41.903052 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:27:41.903052 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:27:41.903999 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:27:41.903999 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:27:41.903999 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:27:41.903999 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:27:41.903999 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:27:41.903999 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:27:41.903999 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:27:41.903999 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:27:41.903999 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:27:41.903999 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:27:41.903999 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:27:41.903999 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application with Lock( Aug 18 19:27:41.903999 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:27:41.903999 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:27:41.903999 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:27:41.903999 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:27:41.904811 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:27:41.904811 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:27:41.904811 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:27:41.904811 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:27:41.904811 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:27:41.904811 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:27:41.904811 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:27:41.904811 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:27:41.904811 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:27:41.904811 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:27:41.904811 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 19:27:41.904811 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:27:41.907886 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 111/214] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Aug 18 19:27:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:27:41.914875 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845ae88d-9c27-41b1-acd6-23b3624954b6 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:41.930024 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:41.948686 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482f9790-7b35-4eab-a2a0-7a32818070bc None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:41.987479 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91556884-0587-48d8-a022-93563502075b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:41.988118 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91556884-0587-48d8-a022-93563502075b None admin] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:41.988397 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91556884-0587-48d8-a022-93563502075b None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:41.988668 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91556884-0587-48d8-a022-93563502075b None admin] PATH_INFO: `/v3/users` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:41.989318 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91556884-0587-48d8-a022-93563502075b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:41.991154 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91556884-0587-48d8-a022-93563502075b None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:42.039416 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845ae88d-9c27-41b1-acd6-23b3624954b6 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:42.155935 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d36206-dff2-4dbf-b0a6-f65e534250ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:42.156543 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d36206-dff2-4dbf-b0a6-f65e534250ad None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:42.156826 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d36206-dff2-4dbf-b0a6-f65e534250ad None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:42.157099 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d36206-dff2-4dbf-b0a6-f65e534250ad None admin] PATH_INFO: `/v3/roles` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:42.157790 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d36206-dff2-4dbf-b0a6-f65e534250ad None admin] RBAC: Adding query filter params (name=member) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:27:42.164428 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d36206-dff2-4dbf-b0a6-f65e534250ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:42.164428 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d36206-dff2-4dbf-b0a6-f65e534250ad None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:42.168047 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 112/215] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Aug 18 19:27:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:27:42.169189 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada902da-f60f-4e26-8ccd-31f32e27cd0f None None] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:42.169494 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada902da-f60f-4e26-8ccd-31f32e27cd0f None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:42.169831 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada902da-f60f-4e26-8ccd-31f32e27cd0f None None] PATH_INFO: `/` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:42.171171 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 113/216] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:27:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:27:42.172043 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be7b8cf-4637-4c78-8238-b58888945f66 None None] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:42.172327 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be7b8cf-4637-4c78-8238-b58888945f66 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:42.172875 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be7b8cf-4637-4c78-8238-b58888945f66 None None] PATH_INFO: `/` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:42.174453 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 114/217] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:27:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:27:42.175354 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be7b8cf-4637-4c78-8238-b58888945f66 None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:42.237469 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:42.274418 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be7b8cf-4637-4c78-8238-b58888945f66 None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:42.291343 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 104/218] 10.222.0.23 () {60 vars in 1132 bytes} [Thu Aug 18 19:27:41 2022] POST /identity/v3/users => generated 297 bytes in 477 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 19:27:42.292576 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c4798-8e1a-4e5b-b7bb-a7b70b4a1f97 None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:42.292863 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c4798-8e1a-4e5b-b7bb-a7b70b4a1f97 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:42.293134 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c4798-8e1a-4e5b-b7bb-a7b70b4a1f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:42.313372 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-672c4798-8e1a-4e5b-b7bb-a7b70b4a1f97 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:27:42.314656 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-672c4798-8e1a-4e5b-b7bb-a7b70b4a1f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:27:42.320260 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9b3c40-39ea-4c21-a507-eae84925f761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:42.320922 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9b3c40-39ea-4c21-a507-eae84925f761 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:42.321199 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9b3c40-39ea-4c21-a507-eae84925f761 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:42.321470 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9b3c40-39ea-4c21-a507-eae84925f761 None admin] PATH_INFO: `/v3/users/aa80cee4e7214072bbc6d4464d4756f2` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:42.338694 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9b3c40-39ea-4c21-a507-eae84925f761 None admin] RBAC: Authorizing `identity:get_user(user_id=aa80cee4e7214072bbc6d4464d4756f2)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:42.340178 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9b3c40-39ea-4c21-a507-eae84925f761 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:42.342084 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 115/219] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Aug 18 19:27:42 2022] GET /identity/v3/users/aa80cee4e7214072bbc6d4464d4756f2 => generated 297 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:27:42.348467 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e2c24d-f9ee-42e8-928d-ac4912eb998a None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:42.348755 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e2c24d-f9ee-42e8-928d-ac4912eb998a None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:42.349034 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e2c24d-f9ee-42e8-928d-ac4912eb998a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:42.370405 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-16e2c24d-f9ee-42e8-928d-ac4912eb998a None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:27:42.371635 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-16e2c24d-f9ee-42e8-928d-ac4912eb998a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:27:42.385137 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:42.404217 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 105/220] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:27:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:27:42.404217 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672c4798-8e1a-4e5b-b7bb-a7b70b4a1f97 None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:42.464963 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 116/221] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:27:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:27:42.516349 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672c4798-8e1a-4e5b-b7bb-a7b70b4a1f97 None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:42.552751 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58283eec-ca63-4af3-88f6-2b16673d51ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:42.553355 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58283eec-ca63-4af3-88f6-2b16673d51ef None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:42.553633 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58283eec-ca63-4af3-88f6-2b16673d51ef None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:42.553938 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58283eec-ca63-4af3-88f6-2b16673d51ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:42.618210 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:42.625204 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58283eec-ca63-4af3-88f6-2b16673d51ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:42.626752 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58283eec-ca63-4af3-88f6-2b16673d51ef None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:42.733614 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e2c24d-f9ee-42e8-928d-ac4912eb998a None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:42.748792 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 106/222] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Aug 18 19:27:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 19:27:42.758221 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58283eec-ca63-4af3-88f6-2b16673d51ef None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:42.811658 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:42.872595 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:42.874902 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e2c24d-f9ee-42e8-928d-ac4912eb998a None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:42.879563 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58283eec-ca63-4af3-88f6-2b16673d51ef None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:42.916545 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0256ad-0805-4205-accb-04a5d7ce4681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:42.917212 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0256ad-0805-4205-accb-04a5d7ce4681 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:42.917470 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0256ad-0805-4205-accb-04a5d7ce4681 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:42.917771 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0256ad-0805-4205-accb-04a5d7ce4681 None admin] PATH_INFO: `/v3/projects/f04621419eb84b00a435d700f145cf48` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:42.921691 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0256ad-0805-4205-accb-04a5d7ce4681 None admin] RBAC: Authorizing `identity:get_project(project_id=f04621419eb84b00a435d700f145cf48)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:42.921691 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0256ad-0805-4205-accb-04a5d7ce4681 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:42.922204 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 107/223] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Aug 18 19:27:42 2022] GET /identity/v3/projects/f04621419eb84b00a435d700f145cf48 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:27:42.923126 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0256ad-0805-4205-accb-04a5d7ce4681 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:42.928085 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b707d8c-8275-4aa0-a4fe-16baf9aa2b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:42.928085 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b707d8c-8275-4aa0-a4fe-16baf9aa2b7f None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:42.928085 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b707d8c-8275-4aa0-a4fe-16baf9aa2b7f None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:42.928085 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b707d8c-8275-4aa0-a4fe-16baf9aa2b7f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:42.942234 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b707d8c-8275-4aa0-a4fe-16baf9aa2b7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:27:42.949034 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application [None req-9b707d8c-8275-4aa0-a4fe-16baf9aa2b7f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 19:27:42.949034 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:27:42.949034 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:27:42.949034 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:27:42.949034 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:27:42.949034 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:27:42.949034 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:27:42.949034 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:27:42.949034 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:27:42.949034 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:27:42.949034 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:27:42.949034 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:27:42.949034 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:27:42.949034 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:27:42.949034 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:27:42.949034 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:27:42.968222 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:27:42.968222 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:27:42.968222 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:27:42.968222 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:27:42.968222 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:27:42.968222 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:27:42.968222 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:27:42.968222 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:27:42.968222 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:27:42.968222 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:27:42.968222 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:27:42.968222 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application with Lock( Aug 18 19:27:42.968222 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:27:42.968222 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:27:42.968222 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:27:42.968222 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:27:42.969003 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:27:42.969003 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:27:42.969003 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:27:42.969003 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:27:42.969003 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:27:42.969003 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:27:42.969003 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:27:42.969003 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:27:42.969003 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:27:42.969003 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:27:42.969003 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 19:27:42.969003 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:27:42.969003 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 117/224] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Aug 18 19:27:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 19:27:42.969003 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b707d8c-8275-4aa0-a4fe-16baf9aa2b7f None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:43.047866 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0256ad-0805-4205-accb-04a5d7ce4681 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:43.085175 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b707d8c-8275-4aa0-a4fe-16baf9aa2b7f None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:43.086886 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7a9aaa-58e3-4f04-ac86-2a84530bebc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:43.087783 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7a9aaa-58e3-4f04-ac86-2a84530bebc1 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:43.088160 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7a9aaa-58e3-4f04-ac86-2a84530bebc1 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:43.088780 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7a9aaa-58e3-4f04-ac86-2a84530bebc1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:43.099807 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:43.104845 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7a9aaa-58e3-4f04-ac86-2a84530bebc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:27:43.110045 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application [None req-3e7a9aaa-58e3-4f04-ac86-2a84530bebc1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 19:27:43.110045 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:27:43.110045 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:27:43.110045 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:27:43.110045 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:27:43.110045 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:27:43.110045 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:27:43.110045 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:27:43.110045 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:27:43.110045 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:27:43.110045 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:27:43.110045 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:27:43.110045 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:27:43.110045 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:27:43.110045 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:27:43.110045 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:27:43.110937 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:27:43.110937 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:27:43.110937 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:27:43.110937 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:27:43.110937 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:27:43.110937 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:27:43.110937 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:27:43.110937 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:27:43.110937 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:27:43.110937 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:27:43.110937 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:27:43.110937 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application with Lock( Aug 18 19:27:43.110937 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:27:43.110937 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:27:43.110937 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:27:43.110937 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:27:43.111726 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:27:43.111726 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:27:43.111726 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:27:43.111726 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:27:43.111726 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:27:43.111726 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:27:43.111726 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:27:43.111726 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:27:43.111726 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:27:43.111726 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:27:43.111726 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 19:27:43.111726 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:27:43.113961 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 108/225] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Aug 18 19:27:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:27:43.114909 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7a9aaa-58e3-4f04-ac86-2a84530bebc1 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:43.127693 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e15260b-6e6a-44b6-850f-625a6c7e31b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:43.128333 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e15260b-6e6a-44b6-850f-625a6c7e31b8 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:43.128595 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e15260b-6e6a-44b6-850f-625a6c7e31b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:43.128971 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e15260b-6e6a-44b6-850f-625a6c7e31b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:43.129914 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e15260b-6e6a-44b6-850f-625a6c7e31b8 None admin] RBAC: Adding query filter params (role.id=ece5eb2bd1334192b3eee1b7b05c042c, scope.project.id=f04621419eb84b00a435d700f145cf48, user.id=aa80cee4e7214072bbc6d4464d4756f2) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:27:43.130224 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e15260b-6e6a-44b6-850f-625a6c7e31b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:43.131890 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e15260b-6e6a-44b6-850f-625a6c7e31b8 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:43.138138 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 118/226] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Aug 18 19:27:42 2022] GET /identity/v3/role_assignments?user.id=aa80cee4e7214072bbc6d4464d4756f2&scope.project.id=f04621419eb84b00a435d700f145cf48&role.id=ece5eb2bd1334192b3eee1b7b05c042c => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:27:43.138969 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e15260b-6e6a-44b6-850f-625a6c7e31b8 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:43.154968 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:43.301827 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7a9aaa-58e3-4f04-ac86-2a84530bebc1 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:43.346151 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2c944d-a2c8-455f-928d-dc8bb0873122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:43.347240 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c944d-a2c8-455f-928d-dc8bb0873122 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:43.347520 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c944d-a2c8-455f-928d-dc8bb0873122 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:43.347792 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c944d-a2c8-455f-928d-dc8bb0873122 None admin] PATH_INFO: `/v3/roles` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:43.348467 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2c944d-a2c8-455f-928d-dc8bb0873122 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:27:43.348769 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2c944d-a2c8-455f-928d-dc8bb0873122 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:43.350770 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2c944d-a2c8-455f-928d-dc8bb0873122 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:43.360219 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 109/227] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Aug 18 19:27:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:27:43.368514 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2c944d-a2c8-455f-928d-dc8bb0873122 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:43.379601 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e15260b-6e6a-44b6-850f-625a6c7e31b8 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:43.439610 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d74957a-6dd4-4eb7-841d-223cd20643d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:43.440234 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d74957a-6dd4-4eb7-841d-223cd20643d5 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:43.440513 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d74957a-6dd4-4eb7-841d-223cd20643d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:43.440786 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d74957a-6dd4-4eb7-841d-223cd20643d5 None admin] PATH_INFO: `/v3/roles` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:43.441444 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d74957a-6dd4-4eb7-841d-223cd20643d5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:27:43.442901 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d74957a-6dd4-4eb7-841d-223cd20643d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:43.445049 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d74957a-6dd4-4eb7-841d-223cd20643d5 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:43.464648 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 119/228] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Aug 18 19:27:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:27:43.472170 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d74957a-6dd4-4eb7-841d-223cd20643d5 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:43.519502 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:43.540349 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:43.577559 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2c944d-a2c8-455f-928d-dc8bb0873122 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:43.587481 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d74957a-6dd4-4eb7-841d-223cd20643d5 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:43.626862 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44538b9b-a037-4736-8c12-c1b2b2eb5fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:43.627508 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44538b9b-a037-4736-8c12-c1b2b2eb5fca None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:43.627793 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44538b9b-a037-4736-8c12-c1b2b2eb5fca None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:43.628070 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44538b9b-a037-4736-8c12-c1b2b2eb5fca None admin] PATH_INFO: `/v3/users/80f1f987a17743e5bf08b3b3141c09eb` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:43.629875 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44538b9b-a037-4736-8c12-c1b2b2eb5fca None admin] RBAC: Authorizing `identity:get_user(user_id=80f1f987a17743e5bf08b3b3141c09eb)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:43.632120 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44538b9b-a037-4736-8c12-c1b2b2eb5fca None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:43.634260 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 120/229] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Aug 18 19:27:43 2022] GET /identity/v3/users/80f1f987a17743e5bf08b3b3141c09eb => generated 283 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:27:43.644173 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44538b9b-a037-4736-8c12-c1b2b2eb5fca None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:43.653901 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6319acf-d415-4df0-abd9-c5d794fe2506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:43.654549 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6319acf-d415-4df0-abd9-c5d794fe2506 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:43.654883 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6319acf-d415-4df0-abd9-c5d794fe2506 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:43.655164 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6319acf-d415-4df0-abd9-c5d794fe2506 None admin] PATH_INFO: `/v3/users/80f1f987a17743e5bf08b3b3141c09eb` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:43.656434 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6319acf-d415-4df0-abd9-c5d794fe2506 None admin] RBAC: Authorizing `identity:get_user(user_id=80f1f987a17743e5bf08b3b3141c09eb)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:43.658692 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6319acf-d415-4df0-abd9-c5d794fe2506 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:43.660580 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 110/230] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Aug 18 19:27:43 2022] GET /identity/v3/users/80f1f987a17743e5bf08b3b3141c09eb => generated 283 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:27:43.666046 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6319acf-d415-4df0-abd9-c5d794fe2506 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:43.844731 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6319acf-d415-4df0-abd9-c5d794fe2506 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:43.879579 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44538b9b-a037-4736-8c12-c1b2b2eb5fca None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:43.894560 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:43.934289 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a13e83-cf46-410e-8770-d0c206b14c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:43.934937 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a13e83-cf46-410e-8770-d0c206b14c0f None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:43.935272 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a13e83-cf46-410e-8770-d0c206b14c0f None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:43.935557 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a13e83-cf46-410e-8770-d0c206b14c0f None admin] PATH_INFO: `/v3/projects/f04621419eb84b00a435d700f145cf48` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:43.936880 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a13e83-cf46-410e-8770-d0c206b14c0f None admin] RBAC: Authorizing `identity:get_project(project_id=f04621419eb84b00a435d700f145cf48)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:43.937052 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18280943-2534-4be3-a2fb-575c1a82b3bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:43.937674 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18280943-2534-4be3-a2fb-575c1a82b3bf None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:43.937957 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18280943-2534-4be3-a2fb-575c1a82b3bf None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:43.938231 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18280943-2534-4be3-a2fb-575c1a82b3bf None admin] PATH_INFO: `/v3/projects/f04621419eb84b00a435d700f145cf48` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:43.938477 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a13e83-cf46-410e-8770-d0c206b14c0f None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:43.942334 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18280943-2534-4be3-a2fb-575c1a82b3bf None admin] RBAC: Authorizing `identity:get_project(project_id=f04621419eb84b00a435d700f145cf48)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:43.943766 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18280943-2534-4be3-a2fb-575c1a82b3bf None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:43.945146 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 121/231] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Aug 18 19:27:43 2022] GET /identity/v3/projects/f04621419eb84b00a435d700f145cf48 => generated 302 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:27:43.945687 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 111/232] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Aug 18 19:27:43 2022] GET /identity/v3/projects/f04621419eb84b00a435d700f145cf48 => generated 302 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:27:43.946363 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a13e83-cf46-410e-8770-d0c206b14c0f None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:43.974028 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18280943-2534-4be3-a2fb-575c1a82b3bf None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:44.034114 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:44.132186 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a13e83-cf46-410e-8770-d0c206b14c0f None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:44.164925 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18280943-2534-4be3-a2fb-575c1a82b3bf None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:44.185973 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38abd55c-4d6f-4399-ac02-fe3a21662ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:44.186639 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38abd55c-4d6f-4399-ac02-fe3a21662ba7 None admin] REQUEST_METHOD: `PUT` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:44.186920 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38abd55c-4d6f-4399-ac02-fe3a21662ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:44.187196 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38abd55c-4d6f-4399-ac02-fe3a21662ba7 None admin] PATH_INFO: `/v3/projects/f04621419eb84b00a435d700f145cf48/users/80f1f987a17743e5bf08b3b3141c09eb/roles/33fe6be3baf44b969c8166af5142e0c7` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:44.190683 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38abd55c-4d6f-4399-ac02-fe3a21662ba7 None admin] RBAC: Authorizing `identity:create_grant(project_id=f04621419eb84b00a435d700f145cf48, user_id=80f1f987a17743e5bf08b3b3141c09eb, role_id=33fe6be3baf44b969c8166af5142e0c7)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:44.192152 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38abd55c-4d6f-4399-ac02-fe3a21662ba7 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:44.226763 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac26fb4-a2f8-4875-8db1-bc73a35066ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:44.230952 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac26fb4-a2f8-4875-8db1-bc73a35066ea None admin] REQUEST_METHOD: `PUT` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:44.230952 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac26fb4-a2f8-4875-8db1-bc73a35066ea None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:44.230952 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac26fb4-a2f8-4875-8db1-bc73a35066ea None admin] PATH_INFO: `/v3/projects/f04621419eb84b00a435d700f145cf48/users/80f1f987a17743e5bf08b3b3141c09eb/roles/629bead347a8449ebece758b5a7ae23d` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:44.236559 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac26fb4-a2f8-4875-8db1-bc73a35066ea None admin] RBAC: Authorizing `identity:create_grant(project_id=f04621419eb84b00a435d700f145cf48, user_id=80f1f987a17743e5bf08b3b3141c09eb, role_id=629bead347a8449ebece758b5a7ae23d)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:44.238495 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac26fb4-a2f8-4875-8db1-bc73a35066ea None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:44.273707 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 122/233] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Aug 18 19:27:43 2022] PUT /identity/v3/projects/f04621419eb84b00a435d700f145cf48/users/80f1f987a17743e5bf08b3b3141c09eb/roles/33fe6be3baf44b969c8166af5142e0c7 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 19:27:44.365460 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 112/234] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Aug 18 19:27:43 2022] PUT /identity/v3/projects/f04621419eb84b00a435d700f145cf48/users/80f1f987a17743e5bf08b3b3141c09eb/roles/629bead347a8449ebece758b5a7ae23d => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 19:27:44.991703 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b8cee8-5961-4f55-998e-3f4d67b2837f None None] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:44.992557 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b8cee8-5961-4f55-998e-3f4d67b2837f None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:44.992978 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b8cee8-5961-4f55-998e-3f4d67b2837f None None] PATH_INFO: `/` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:44.994799 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 123/235] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:27:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:27:45.000238 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12807924-ea38-490b-9511-c462d769e7bf None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:45.000820 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12807924-ea38-490b-9511-c462d769e7bf None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:45.001239 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12807924-ea38-490b-9511-c462d769e7bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:45.029895 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-12807924-ea38-490b-9511-c462d769e7bf None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:27:45.031280 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-12807924-ea38-490b-9511-c462d769e7bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:27:45.038411 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1496fa3-6834-4b24-90d5-9074c62eb206 None None] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:45.039046 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1496fa3-6834-4b24-90d5-9074c62eb206 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:45.039519 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1496fa3-6834-4b24-90d5-9074c62eb206 None None] PATH_INFO: `/` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:45.041395 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 124/236] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:27:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:27:45.047174 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e600ead2-5456-4806-a6b9-628e3496341d None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:45.048251 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e600ead2-5456-4806-a6b9-628e3496341d None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:45.048728 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e600ead2-5456-4806-a6b9-628e3496341d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:45.082280 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-e600ead2-5456-4806-a6b9-628e3496341d None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:27:45.085851 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-e600ead2-5456-4806-a6b9-628e3496341d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:27:45.144511 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:45.167502 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 113/237] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:27:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:27:45.197605 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 125/238] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:27:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:27:45.519369 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12807924-ea38-490b-9511-c462d769e7bf None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:45.535274 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:45.641580 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e600ead2-5456-4806-a6b9-628e3496341d None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:45.652405 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12807924-ea38-490b-9511-c462d769e7bf None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:45.705191 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa9bcc3-eaff-45ed-88bb-41be72ebab76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:45.706202 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa9bcc3-eaff-45ed-88bb-41be72ebab76 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:45.706680 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa9bcc3-eaff-45ed-88bb-41be72ebab76 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:45.707143 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa9bcc3-eaff-45ed-88bb-41be72ebab76 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:45.724093 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa9bcc3-eaff-45ed-88bb-41be72ebab76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:27:45.729135 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application [None req-1fa9bcc3-eaff-45ed-88bb-41be72ebab76 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 19:27:45.729135 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:27:45.729135 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:27:45.729135 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:27:45.729135 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:27:45.729135 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:27:45.729135 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:27:45.729135 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:27:45.729135 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:27:45.729135 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:27:45.729135 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:27:45.729135 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:27:45.729135 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:27:45.729135 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:27:45.729135 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:27:45.729135 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:27:45.730041 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:27:45.730041 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:27:45.730041 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:27:45.730041 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:27:45.730041 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:27:45.730041 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:27:45.730041 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:27:45.730041 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:27:45.730041 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:27:45.730041 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:27:45.730041 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:27:45.730041 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application with Lock( Aug 18 19:27:45.730041 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:27:45.730041 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:27:45.730041 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:27:45.730041 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:27:45.730848 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:27:45.730848 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:27:45.730848 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:27:45.730848 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:27:45.730848 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:27:45.730848 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:27:45.730848 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:27:45.730848 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:27:45.730848 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:27:45.730848 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:27:45.730848 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 19:27:45.730848 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:27:45.739352 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 114/239] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Aug 18 19:27:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:27:45.745187 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa9bcc3-eaff-45ed-88bb-41be72ebab76 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:45.753574 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e600ead2-5456-4806-a6b9-628e3496341d None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:45.790270 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3163744d-8bda-4248-86d5-91469dcad04e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:45.790821 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3163744d-8bda-4248-86d5-91469dcad04e None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:45.791096 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3163744d-8bda-4248-86d5-91469dcad04e None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:45.791362 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3163744d-8bda-4248-86d5-91469dcad04e None admin] PATH_INFO: `/v3/domains/default` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:45.797675 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3163744d-8bda-4248-86d5-91469dcad04e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:45.797675 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3163744d-8bda-4248-86d5-91469dcad04e None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:45.797675 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 126/240] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Aug 18 19:27:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:27:45.801807 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3163744d-8bda-4248-86d5-91469dcad04e None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:45.834986 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:45.892496 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa9bcc3-eaff-45ed-88bb-41be72ebab76 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:45.901712 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:45.910539 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3163744d-8bda-4248-86d5-91469dcad04e None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:45.935055 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55f1383-2424-4573-94a7-f9b1c279245b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:45.936137 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55f1383-2424-4573-94a7-f9b1c279245b None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:45.936427 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55f1383-2424-4573-94a7-f9b1c279245b None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:45.936704 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55f1383-2424-4573-94a7-f9b1c279245b None admin] PATH_INFO: `/v3/roles` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:45.937374 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55f1383-2424-4573-94a7-f9b1c279245b None admin] RBAC: Adding query filter params (name=reader) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:27:45.937698 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55f1383-2424-4573-94a7-f9b1c279245b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:45.939301 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55f1383-2424-4573-94a7-f9b1c279245b None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:45.948646 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 115/241] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Aug 18 19:27:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:27:45.950785 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5091ba21-2769-44aa-b6a2-bc481ab317f0 None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:45.951231 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5091ba21-2769-44aa-b6a2-bc481ab317f0 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:45.951662 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5091ba21-2769-44aa-b6a2-bc481ab317f0 None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:45.953864 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 116/242] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:27:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:27:45.955249 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5091ba21-2769-44aa-b6a2-bc481ab317f0 None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:45.957207 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f10dba0-8b99-4a94-9cba-d2e52df5780d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:45.958490 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f10dba0-8b99-4a94-9cba-d2e52df5780d None admin] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:45.959054 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f10dba0-8b99-4a94-9cba-d2e52df5780d None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:45.959492 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f10dba0-8b99-4a94-9cba-d2e52df5780d None admin] PATH_INFO: `/v3/users` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:45.960383 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f10dba0-8b99-4a94-9cba-d2e52df5780d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:45.962383 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f10dba0-8b99-4a94-9cba-d2e52df5780d None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:46.049286 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 127/243] 10.222.0.23 () {60 vars in 1132 bytes} [Thu Aug 18 19:27:45 2022] POST /identity/v3/users => generated 293 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 19:27:46.050570 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bacd82-84ff-4bfe-9a2d-c01cb688f3c1 None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:46.050876 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bacd82-84ff-4bfe-9a2d-c01cb688f3c1 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:46.051152 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bacd82-84ff-4bfe-9a2d-c01cb688f3c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:46.088601 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5091ba21-2769-44aa-b6a2-bc481ab317f0 None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:46.131327 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-51bacd82-84ff-4bfe-9a2d-c01cb688f3c1 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:27:46.132854 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-51bacd82-84ff-4bfe-9a2d-c01cb688f3c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:27:46.199910 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8585c6-3e39-4d46-b44e-e58a48d79b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:46.200671 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8585c6-3e39-4d46-b44e-e58a48d79b28 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:46.200956 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8585c6-3e39-4d46-b44e-e58a48d79b28 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:46.201229 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8585c6-3e39-4d46-b44e-e58a48d79b28 None admin] PATH_INFO: `/v3/users/2d09a921ef944be09a500c5d25fd55f7` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:46.206829 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:46.238818 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8585c6-3e39-4d46-b44e-e58a48d79b28 None admin] RBAC: Authorizing `identity:get_user(user_id=2d09a921ef944be09a500c5d25fd55f7)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:46.240316 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8585c6-3e39-4d46-b44e-e58a48d79b28 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:46.242325 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 117/244] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Aug 18 19:27:45 2022] GET /identity/v3/users/2d09a921ef944be09a500c5d25fd55f7 => generated 297 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:27:46.251315 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8585c6-3e39-4d46-b44e-e58a48d79b28 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:46.269409 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 128/245] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:27:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:27:46.368557 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8585c6-3e39-4d46-b44e-e58a48d79b28 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:46.404456 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930a3a00-1809-4f83-87e4-6784ad20df35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:46.405111 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a3a00-1809-4f83-87e4-6784ad20df35 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:46.405392 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a3a00-1809-4f83-87e4-6784ad20df35 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:46.405684 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a3a00-1809-4f83-87e4-6784ad20df35 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:46.468139 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:46.478857 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930a3a00-1809-4f83-87e4-6784ad20df35 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:46.480514 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930a3a00-1809-4f83-87e4-6784ad20df35 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:46.601784 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 118/246] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Aug 18 19:27:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 19:27:46.607447 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bacd82-84ff-4bfe-9a2d-c01cb688f3c1 None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:46.633641 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:46.653638 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930a3a00-1809-4f83-87e4-6784ad20df35 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:46.773797 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bacd82-84ff-4bfe-9a2d-c01cb688f3c1 None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:46.789778 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:46.799435 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930a3a00-1809-4f83-87e4-6784ad20df35 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:46.814463 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fcd2b4-7bd1-4c3c-9423-3a37949490d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:46.815329 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fcd2b4-7bd1-4c3c-9423-3a37949490d2 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:46.815746 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fcd2b4-7bd1-4c3c-9423-3a37949490d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:46.816170 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fcd2b4-7bd1-4c3c-9423-3a37949490d2 None admin] PATH_INFO: `/v3/projects/f04621419eb84b00a435d700f145cf48` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:46.817437 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fcd2b4-7bd1-4c3c-9423-3a37949490d2 None admin] RBAC: Authorizing `identity:get_project(project_id=f04621419eb84b00a435d700f145cf48)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:46.819053 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fcd2b4-7bd1-4c3c-9423-3a37949490d2 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:46.820853 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 129/247] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Aug 18 19:27:46 2022] GET /identity/v3/projects/f04621419eb84b00a435d700f145cf48 => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:27:46.826838 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fcd2b4-7bd1-4c3c-9423-3a37949490d2 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:46.858855 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898d5505-f7a9-4ba9-a4e1-2d0fa46f1c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:46.859557 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898d5505-f7a9-4ba9-a4e1-2d0fa46f1c3e None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:46.859766 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898d5505-f7a9-4ba9-a4e1-2d0fa46f1c3e None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:46.860045 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898d5505-f7a9-4ba9-a4e1-2d0fa46f1c3e None admin] PATH_INFO: `/v3/roles/member` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:46.874229 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898d5505-f7a9-4ba9-a4e1-2d0fa46f1c3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:27:46.880474 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application [None req-898d5505-f7a9-4ba9-a4e1-2d0fa46f1c3e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 19:27:46.880474 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:27:46.880474 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:27:46.880474 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:27:46.880474 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:27:46.880474 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:27:46.880474 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:27:46.880474 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:27:46.880474 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:27:46.880474 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:27:46.880474 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:27:46.880474 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:27:46.880474 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:27:46.880474 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:27:46.880474 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:27:46.880474 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:27:46.881352 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:27:46.881352 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:27:46.881352 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:27:46.881352 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:27:46.881352 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:27:46.881352 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:27:46.881352 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:27:46.881352 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:27:46.881352 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:27:46.881352 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:27:46.881352 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:27:46.881352 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application with Lock( Aug 18 19:27:46.881352 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:27:46.881352 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:27:46.881352 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:27:46.881352 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:27:46.882253 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:27:46.882253 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:27:46.882253 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:27:46.882253 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:27:46.882253 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:27:46.882253 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:27:46.882253 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:27:46.882253 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:27:46.882253 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:27:46.882253 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:27:46.882253 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 19:27:46.882253 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:27:46.882253 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 119/248] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Aug 18 19:27:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 19:27:46.890689 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898d5505-f7a9-4ba9-a4e1-2d0fa46f1c3e None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:46.934878 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:46.952180 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fcd2b4-7bd1-4c3c-9423-3a37949490d2 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:46.991123 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34928d36-c198-4f4f-80af-7c6b5d5e4b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:46.992054 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34928d36-c198-4f4f-80af-7c6b5d5e4b47 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:46.992508 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34928d36-c198-4f4f-80af-7c6b5d5e4b47 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:46.992946 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34928d36-c198-4f4f-80af-7c6b5d5e4b47 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:46.993909 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34928d36-c198-4f4f-80af-7c6b5d5e4b47 None admin] RBAC: Adding query filter params (role.id=9aa2d4ac6d7540c68a34e8ffba0e545d, scope.project.id=f04621419eb84b00a435d700f145cf48, user.id=2d09a921ef944be09a500c5d25fd55f7) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:27:46.994493 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34928d36-c198-4f4f-80af-7c6b5d5e4b47 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:46.996495 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34928d36-c198-4f4f-80af-7c6b5d5e4b47 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:47.004321 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 130/249] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Aug 18 19:27:46 2022] GET /identity/v3/role_assignments?user.id=2d09a921ef944be09a500c5d25fd55f7&scope.project.id=f04621419eb84b00a435d700f145cf48&role.id=9aa2d4ac6d7540c68a34e8ffba0e545d => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:27:47.079766 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898d5505-f7a9-4ba9-a4e1-2d0fa46f1c3e None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:47.136880 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a347099e-d02d-4898-9acb-edd29f436ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:47.137897 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a347099e-d02d-4898-9acb-edd29f436ce7 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:47.138359 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a347099e-d02d-4898-9acb-edd29f436ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:47.138808 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a347099e-d02d-4898-9acb-edd29f436ce7 None admin] PATH_INFO: `/v3/roles` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:47.139781 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a347099e-d02d-4898-9acb-edd29f436ce7 None admin] RBAC: Adding query filter params (name=member) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:27:47.140272 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a347099e-d02d-4898-9acb-edd29f436ce7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:47.142005 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a347099e-d02d-4898-9acb-edd29f436ce7 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:47.151805 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 120/250] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Aug 18 19:27:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:27:47.157882 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34928d36-c198-4f4f-80af-7c6b5d5e4b47 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:47.165830 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a4c78e-c72d-4acf-8f77-7c9636456c79 None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:47.166125 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a4c78e-c72d-4acf-8f77-7c9636456c79 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:47.166377 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a4c78e-c72d-4acf-8f77-7c9636456c79 None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:47.168083 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 121/251] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:27:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 19:27:47.179544 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d5ba0c-ce1c-4c20-addf-5a5035eea9f2 None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:47.179925 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d5ba0c-ce1c-4c20-addf-5a5035eea9f2 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:47.180114 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d5ba0c-ce1c-4c20-addf-5a5035eea9f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:47.217863 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-41d5ba0c-ce1c-4c20-addf-5a5035eea9f2 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:27:47.217863 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-41d5ba0c-ce1c-4c20-addf-5a5035eea9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:27:47.238020 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:47.314346 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34928d36-c198-4f4f-80af-7c6b5d5e4b47 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:47.356850 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d149e97-be34-433c-8a79-844514811ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:47.357624 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d149e97-be34-433c-8a79-844514811ffd None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:47.357931 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d149e97-be34-433c-8a79-844514811ffd None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:47.358202 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d149e97-be34-433c-8a79-844514811ffd None admin] PATH_INFO: `/v3/users/aa80cee4e7214072bbc6d4464d4756f2` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:47.360296 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d149e97-be34-433c-8a79-844514811ffd None admin] RBAC: Authorizing `identity:get_user(user_id=aa80cee4e7214072bbc6d4464d4756f2)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:47.362694 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d149e97-be34-433c-8a79-844514811ffd None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:47.364897 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 131/252] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Aug 18 19:27:47 2022] GET /identity/v3/users/aa80cee4e7214072bbc6d4464d4756f2 => generated 297 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:27:47.371597 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d149e97-be34-433c-8a79-844514811ffd None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:47.372146 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 122/253] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:27:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 19:27:47.387815 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babc5974-dd09-49a0-9cc8-8aee8fcd1669 None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:47.388948 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babc5974-dd09-49a0-9cc8-8aee8fcd1669 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:47.389426 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babc5974-dd09-49a0-9cc8-8aee8fcd1669 None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:47.391253 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 123/254] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:27:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 19:27:47.397375 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6538c629-9596-4057-b20c-982fbda9dbb1 None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:47.397968 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6538c629-9596-4057-b20c-982fbda9dbb1 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:47.398437 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6538c629-9596-4057-b20c-982fbda9dbb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:47.419690 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:47.420206 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-6538c629-9596-4057-b20c-982fbda9dbb1 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:27:47.421636 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-6538c629-9596-4057-b20c-982fbda9dbb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:27:47.509171 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 124/255] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:27:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 19:27:47.561716 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d149e97-be34-433c-8a79-844514811ffd None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:47.608736 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073374db-02bc-4274-bac4-93ed3b726aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:47.609363 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073374db-02bc-4274-bac4-93ed3b726aa1 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:47.609641 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073374db-02bc-4274-bac4-93ed3b726aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:47.609931 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073374db-02bc-4274-bac4-93ed3b726aa1 None admin] PATH_INFO: `/v3/projects/f04621419eb84b00a435d700f145cf48` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:47.611819 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073374db-02bc-4274-bac4-93ed3b726aa1 None admin] RBAC: Authorizing `identity:get_project(project_id=f04621419eb84b00a435d700f145cf48)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:47.613259 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073374db-02bc-4274-bac4-93ed3b726aa1 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:47.615070 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 132/256] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Aug 18 19:27:47 2022] GET /identity/v3/projects/f04621419eb84b00a435d700f145cf48 => generated 302 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:27:47.620820 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6538c629-9596-4057-b20c-982fbda9dbb1 None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:47.711760 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:47.744464 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6538c629-9596-4057-b20c-982fbda9dbb1 None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:47.779492 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afb20e7-0b4c-4ed2-8152-5b5c5042fb84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:47.780201 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb20e7-0b4c-4ed2-8152-5b5c5042fb84 None admin] REQUEST_METHOD: `PUT` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:47.780476 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb20e7-0b4c-4ed2-8152-5b5c5042fb84 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:47.780744 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb20e7-0b4c-4ed2-8152-5b5c5042fb84 None admin] PATH_INFO: `/v3/projects/f04621419eb84b00a435d700f145cf48/users/aa80cee4e7214072bbc6d4464d4756f2/roles/ece5eb2bd1334192b3eee1b7b05c042c` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:47.783332 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afb20e7-0b4c-4ed2-8152-5b5c5042fb84 None admin] RBAC: Authorizing `identity:create_grant(project_id=f04621419eb84b00a435d700f145cf48, user_id=aa80cee4e7214072bbc6d4464d4756f2, role_id=ece5eb2bd1334192b3eee1b7b05c042c)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:47.784758 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afb20e7-0b4c-4ed2-8152-5b5c5042fb84 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:47.846900 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073374db-02bc-4274-bac4-93ed3b726aa1 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:47.865076 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 125/257] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Aug 18 19:27:47 2022] PUT /identity/v3/projects/f04621419eb84b00a435d700f145cf48/users/aa80cee4e7214072bbc6d4464d4756f2/roles/ece5eb2bd1334192b3eee1b7b05c042c => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 19:27:47.946556 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:47.963676 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073374db-02bc-4274-bac4-93ed3b726aa1 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:48.003456 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b529f3f-319a-4d2c-ad40-7fd1923c78ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:48.004452 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b529f3f-319a-4d2c-ad40-7fd1923c78ab None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:48.004922 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b529f3f-319a-4d2c-ad40-7fd1923c78ab None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:48.005421 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b529f3f-319a-4d2c-ad40-7fd1923c78ab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:48.016494 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b529f3f-319a-4d2c-ad40-7fd1923c78ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:27:48.023460 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application [None req-0b529f3f-319a-4d2c-ad40-7fd1923c78ab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 19:27:48.023460 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:27:48.023460 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:27:48.023460 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:27:48.023460 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:27:48.023460 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:27:48.023460 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:27:48.023460 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:27:48.023460 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:27:48.023460 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:27:48.023460 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:27:48.023460 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:27:48.023460 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:27:48.023460 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:27:48.023460 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:27:48.023460 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:27:48.024399 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:27:48.024399 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:27:48.024399 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:27:48.024399 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:27:48.024399 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:27:48.024399 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:27:48.024399 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:27:48.024399 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:27:48.024399 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:27:48.024399 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:27:48.024399 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:27:48.024399 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application with Lock( Aug 18 19:27:48.024399 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:27:48.024399 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:27:48.024399 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:27:48.024399 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:27:48.025183 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:27:48.025183 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:27:48.025183 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:27:48.025183 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:27:48.025183 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:27:48.025183 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:27:48.025183 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:27:48.025183 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:27:48.025183 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:27:48.025183 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:27:48.025183 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 19:27:48.025183 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:27:48.027743 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 133/258] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Aug 18 19:27:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 19:27:48.034634 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afb20e7-0b4c-4ed2-8152-5b5c5042fb84 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:48.052034 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b529f3f-319a-4d2c-ad40-7fd1923c78ab None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:48.165721 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b529f3f-319a-4d2c-ad40-7fd1923c78ab None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:48.208720 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee980da-aeb0-442c-a9ba-a0e6c4326eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:48.208720 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee980da-aeb0-442c-a9ba-a0e6c4326eb1 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:48.208720 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee980da-aeb0-442c-a9ba-a0e6c4326eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:48.208720 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee980da-aeb0-442c-a9ba-a0e6c4326eb1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:48.214391 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afb20e7-0b4c-4ed2-8152-5b5c5042fb84 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:48.219270 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee980da-aeb0-442c-a9ba-a0e6c4326eb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:27:48.225455 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application [None req-eee980da-aeb0-442c-a9ba-a0e6c4326eb1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 19:27:48.225455 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:27:48.225455 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:27:48.225455 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:27:48.225455 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:27:48.225455 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:27:48.225455 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:27:48.225455 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:27:48.225455 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:27:48.225455 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:27:48.225455 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:27:48.225455 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:27:48.225455 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:27:48.225455 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:27:48.225455 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:27:48.225455 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:27:48.226399 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:27:48.226399 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:27:48.226399 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:27:48.226399 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:27:48.226399 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:27:48.226399 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:27:48.226399 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:27:48.226399 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:27:48.226399 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:27:48.226399 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:27:48.226399 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:27:48.226399 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application with Lock( Aug 18 19:27:48.226399 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:27:48.226399 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:27:48.226399 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:27:48.226399 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:27:48.227195 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:27:48.227195 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:27:48.227195 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:27:48.227195 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:27:48.227195 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:27:48.227195 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:27:48.227195 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:27:48.227195 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:27:48.227195 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:27:48.227195 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:27:48.227195 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 19:27:48.227195 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:27:48.227195 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 134/259] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Aug 18 19:27:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 19:27:48.234877 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee980da-aeb0-442c-a9ba-a0e6c4326eb1 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:48.246010 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:48.290138 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849d03b1-ef1b-4329-a91d-42ff17fc253f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:48.290756 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849d03b1-ef1b-4329-a91d-42ff17fc253f None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:48.291033 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849d03b1-ef1b-4329-a91d-42ff17fc253f None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:48.291304 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849d03b1-ef1b-4329-a91d-42ff17fc253f None admin] PATH_INFO: `/v3/roles` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:48.291967 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849d03b1-ef1b-4329-a91d-42ff17fc253f None admin] RBAC: Adding query filter params (name=admin) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:27:48.292269 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849d03b1-ef1b-4329-a91d-42ff17fc253f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:48.293639 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849d03b1-ef1b-4329-a91d-42ff17fc253f None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:48.305152 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:48.317203 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 126/260] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Aug 18 19:27:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:27:48.323873 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849d03b1-ef1b-4329-a91d-42ff17fc253f None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:48.422040 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee980da-aeb0-442c-a9ba-a0e6c4326eb1 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:48.487514 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e4df0-b8c9-4017-b9ad-477cdda4e5b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:48.488037 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e4df0-b8c9-4017-b9ad-477cdda4e5b2 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:48.488304 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e4df0-b8c9-4017-b9ad-477cdda4e5b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:48.488573 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e4df0-b8c9-4017-b9ad-477cdda4e5b2 None admin] PATH_INFO: `/v3/roles` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:48.489232 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51e4df0-b8c9-4017-b9ad-477cdda4e5b2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:27:48.489526 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51e4df0-b8c9-4017-b9ad-477cdda4e5b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:48.490936 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51e4df0-b8c9-4017-b9ad-477cdda4e5b2 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:48.494242 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849d03b1-ef1b-4329-a91d-42ff17fc253f None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:48.509321 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 135/261] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Aug 18 19:27:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:27:48.516830 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e4df0-b8c9-4017-b9ad-477cdda4e5b2 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:48.556989 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fa782c-4144-4427-b1c0-c518de1898b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:48.557626 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fa782c-4144-4427-b1c0-c518de1898b7 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:48.557927 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fa782c-4144-4427-b1c0-c518de1898b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:48.558199 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fa782c-4144-4427-b1c0-c518de1898b7 None admin] PATH_INFO: `/v3/users/80f1f987a17743e5bf08b3b3141c09eb` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:48.559435 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fa782c-4144-4427-b1c0-c518de1898b7 None admin] RBAC: Authorizing `identity:get_user(user_id=80f1f987a17743e5bf08b3b3141c09eb)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:48.560873 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fa782c-4144-4427-b1c0-c518de1898b7 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:48.563663 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 127/262] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Aug 18 19:27:48 2022] GET /identity/v3/users/80f1f987a17743e5bf08b3b3141c09eb => generated 283 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:27:48.570861 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fa782c-4144-4427-b1c0-c518de1898b7 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:48.634650 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:48.706251 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e4df0-b8c9-4017-b9ad-477cdda4e5b2 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:48.710546 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:48.770876 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25531d78-6164-40ee-ae46-0ba32276c822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:48.771442 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25531d78-6164-40ee-ae46-0ba32276c822 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:48.771719 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25531d78-6164-40ee-ae46-0ba32276c822 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:48.773850 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25531d78-6164-40ee-ae46-0ba32276c822 None admin] PATH_INFO: `/v3/users/80f1f987a17743e5bf08b3b3141c09eb` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:48.774725 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25531d78-6164-40ee-ae46-0ba32276c822 None admin] RBAC: Authorizing `identity:get_user(user_id=80f1f987a17743e5bf08b3b3141c09eb)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:48.776255 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25531d78-6164-40ee-ae46-0ba32276c822 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:48.777939 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 136/263] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Aug 18 19:27:48 2022] GET /identity/v3/users/80f1f987a17743e5bf08b3b3141c09eb => generated 283 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:27:48.784303 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25531d78-6164-40ee-ae46-0ba32276c822 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:48.785879 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fa782c-4144-4427-b1c0-c518de1898b7 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:48.847452 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc0afd1-eac6-4da5-b1a6-c84cbc87d1a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:48.848086 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc0afd1-eac6-4da5-b1a6-c84cbc87d1a0 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:48.848368 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc0afd1-eac6-4da5-b1a6-c84cbc87d1a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:48.848642 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc0afd1-eac6-4da5-b1a6-c84cbc87d1a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:48.969004 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc0afd1-eac6-4da5-b1a6-c84cbc87d1a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:48.971375 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc0afd1-eac6-4da5-b1a6-c84cbc87d1a0 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:49.024508 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25531d78-6164-40ee-ae46-0ba32276c822 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:49.054876 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:49.100727 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 128/264] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Aug 18 19:27:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 18 19:27:49.106014 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc0afd1-eac6-4da5-b1a6-c84cbc87d1a0 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:49.109565 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a083013-20de-475a-b2eb-49b998f448b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:49.111151 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a083013-20de-475a-b2eb-49b998f448b7 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:49.112483 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a083013-20de-475a-b2eb-49b998f448b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:49.112956 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a083013-20de-475a-b2eb-49b998f448b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:49.121410 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:49.244806 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a083013-20de-475a-b2eb-49b998f448b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:49.251042 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a083013-20de-475a-b2eb-49b998f448b7 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:49.301218 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc0afd1-eac6-4da5-b1a6-c84cbc87d1a0 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:49.365827 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca3a21-b71c-4a6e-ab63-96ed3ac17d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:49.366844 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca3a21-b71c-4a6e-ab63-96ed3ac17d63 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:49.367843 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca3a21-b71c-4a6e-ab63-96ed3ac17d63 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:49.368447 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca3a21-b71c-4a6e-ab63-96ed3ac17d63 None admin] PATH_INFO: `/v3/projects/f04621419eb84b00a435d700f145cf48` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:49.371332 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eca3a21-b71c-4a6e-ab63-96ed3ac17d63 None admin] RBAC: Authorizing `identity:get_project(project_id=f04621419eb84b00a435d700f145cf48)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:49.373080 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eca3a21-b71c-4a6e-ab63-96ed3ac17d63 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:49.375559 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 129/265] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Aug 18 19:27:49 2022] GET /identity/v3/projects/f04621419eb84b00a435d700f145cf48 => generated 302 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:27:49.382370 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca3a21-b71c-4a6e-ab63-96ed3ac17d63 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:49.436195 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:49.512890 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 137/266] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Aug 18 19:27:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 729 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 18 19:27:49.519046 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a083013-20de-475a-b2eb-49b998f448b7 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:49.553184 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca3a21-b71c-4a6e-ab63-96ed3ac17d63 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:49.602119 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4f8e98-6123-4b15-816d-e4e8ef474392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:49.603121 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f8e98-6123-4b15-816d-e4e8ef474392 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:49.603589 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f8e98-6123-4b15-816d-e4e8ef474392 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:49.604114 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f8e98-6123-4b15-816d-e4e8ef474392 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:49.605013 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4f8e98-6123-4b15-816d-e4e8ef474392 None admin] RBAC: Adding query filter params (role.id=33fe6be3baf44b969c8166af5142e0c7, scope.project.id=f04621419eb84b00a435d700f145cf48, user.id=80f1f987a17743e5bf08b3b3141c09eb) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:27:49.605511 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4f8e98-6123-4b15-816d-e4e8ef474392 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:49.606691 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:49.608117 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4f8e98-6123-4b15-816d-e4e8ef474392 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:49.620438 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 130/267] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Aug 18 19:27:49 2022] GET /identity/v3/role_assignments?user.id=80f1f987a17743e5bf08b3b3141c09eb&scope.project.id=f04621419eb84b00a435d700f145cf48&role.id=33fe6be3baf44b969c8166af5142e0c7 => generated 608 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:27:49.711715 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a083013-20de-475a-b2eb-49b998f448b7 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:49.763927 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4880bf-2a3f-41d2-b0ac-4faaf312ffd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:49.764572 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4880bf-2a3f-41d2-b0ac-4faaf312ffd1 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:49.764854 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4880bf-2a3f-41d2-b0ac-4faaf312ffd1 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:49.765125 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4880bf-2a3f-41d2-b0ac-4faaf312ffd1 None admin] PATH_INFO: `/v3/projects/f04621419eb84b00a435d700f145cf48` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:49.770370 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4880bf-2a3f-41d2-b0ac-4faaf312ffd1 None admin] RBAC: Authorizing `identity:get_project(project_id=f04621419eb84b00a435d700f145cf48)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:49.771908 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4880bf-2a3f-41d2-b0ac-4faaf312ffd1 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:49.774081 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 138/268] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Aug 18 19:27:49 2022] GET /identity/v3/projects/f04621419eb84b00a435d700f145cf48 => generated 302 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:27:49.780236 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4f8e98-6123-4b15-816d-e4e8ef474392 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:49.933564 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:49.939148 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4f8e98-6123-4b15-816d-e4e8ef474392 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:49.976286 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba979750-bd7d-439e-9904-f13634aa6b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:49.976897 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba979750-bd7d-439e-9904-f13634aa6b9f None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:49.977178 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba979750-bd7d-439e-9904-f13634aa6b9f None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:49.977451 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba979750-bd7d-439e-9904-f13634aa6b9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:49.978222 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba979750-bd7d-439e-9904-f13634aa6b9f None admin] RBAC: Adding query filter params (role.id=629bead347a8449ebece758b5a7ae23d, scope.project.id=f04621419eb84b00a435d700f145cf48, user.id=80f1f987a17743e5bf08b3b3141c09eb) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:27:49.978527 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba979750-bd7d-439e-9904-f13634aa6b9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:49.980045 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba979750-bd7d-439e-9904-f13634aa6b9f None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:49.987111 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 131/269] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Aug 18 19:27:49 2022] GET /identity/v3/role_assignments?user.id=80f1f987a17743e5bf08b3b3141c09eb&scope.project.id=f04621419eb84b00a435d700f145cf48&role.id=629bead347a8449ebece758b5a7ae23d => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:27:49.991560 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49db09f4-b6e6-4732-8b89-fddaa43a5024 None None] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:49.992018 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49db09f4-b6e6-4732-8b89-fddaa43a5024 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:49.992458 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49db09f4-b6e6-4732-8b89-fddaa43a5024 None None] PATH_INFO: `/` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:49.998968 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 139/270] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:27:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:27:50.002378 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dafd0f-a77e-4d39-b514-aa62ebdc8e44 None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:50.002858 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dafd0f-a77e-4d39-b514-aa62ebdc8e44 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:50.003316 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dafd0f-a77e-4d39-b514-aa62ebdc8e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:50.023679 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-b1dafd0f-a77e-4d39-b514-aa62ebdc8e44 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:27:50.024895 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-b1dafd0f-a77e-4d39-b514-aa62ebdc8e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:27:50.101480 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 132/271] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:27:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:27:50.135656 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf071d-b593-4f1f-8ee6-a6e991dbf9c8 None None] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:50.136221 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf071d-b593-4f1f-8ee6-a6e991dbf9c8 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:50.136673 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf071d-b593-4f1f-8ee6-a6e991dbf9c8 None None] PATH_INFO: `/` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:50.138218 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 140/272] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:27:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:27:50.155771 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c7ec0f-47e0-454a-ab01-190523e7c337 None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:50.156137 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c7ec0f-47e0-454a-ab01-190523e7c337 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:50.156333 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c7ec0f-47e0-454a-ab01-190523e7c337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:50.181962 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-89c7ec0f-47e0-454a-ab01-190523e7c337 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:27:50.183212 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-89c7ec0f-47e0-454a-ab01-190523e7c337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:27:50.272795 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 133/273] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:27:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:27:50.449688 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e0002e-0698-4a22-9434-60712b4143e4 None None] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:50.450773 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e0002e-0698-4a22-9434-60712b4143e4 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:50.451277 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e0002e-0698-4a22-9434-60712b4143e4 None None] PATH_INFO: `/` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:50.453068 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 141/274] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:27:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:27:50.459413 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5676bed9-6693-42c7-b7f6-9fbf7fcd4a5c None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:50.459764 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5676bed9-6693-42c7-b7f6-9fbf7fcd4a5c None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:50.460044 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5676bed9-6693-42c7-b7f6-9fbf7fcd4a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:50.482702 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-5676bed9-6693-42c7-b7f6-9fbf7fcd4a5c None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:27:50.484148 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-5676bed9-6693-42c7-b7f6-9fbf7fcd4a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:27:50.500072 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:50.562235 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 134/275] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:27:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:27:50.583283 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e0002e-0698-4a22-9434-60712b4143e4 None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:50.677247 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5676bed9-6693-42c7-b7f6-9fbf7fcd4a5c None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:50.710194 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e0002e-0698-4a22-9434-60712b4143e4 None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:50.712812 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:50.750220 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e94556-9736-4cee-9bfd-56ec1a7a6063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:50.751557 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e94556-9736-4cee-9bfd-56ec1a7a6063 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:50.752315 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e94556-9736-4cee-9bfd-56ec1a7a6063 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:50.752994 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e94556-9736-4cee-9bfd-56ec1a7a6063 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:50.754356 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e94556-9736-4cee-9bfd-56ec1a7a6063 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:50.756672 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e94556-9736-4cee-9bfd-56ec1a7a6063 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:50.760990 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 142/276] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Aug 18 19:27:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:27:50.767560 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e94556-9736-4cee-9bfd-56ec1a7a6063 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:50.793886 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5676bed9-6693-42c7-b7f6-9fbf7fcd4a5c None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:50.830481 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22087261-68ca-4a17-b56b-708c343592df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:50.831639 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22087261-68ca-4a17-b56b-708c343592df None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:50.832081 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22087261-68ca-4a17-b56b-708c343592df None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:50.832636 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22087261-68ca-4a17-b56b-708c343592df None admin] PATH_INFO: `/v3/roles/member` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:50.846919 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22087261-68ca-4a17-b56b-708c343592df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:27:50.853531 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application [None req-22087261-68ca-4a17-b56b-708c343592df None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 19:27:50.853531 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:27:50.853531 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:27:50.853531 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:27:50.853531 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:27:50.853531 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:27:50.853531 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:27:50.853531 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:27:50.853531 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:27:50.853531 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:27:50.853531 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:27:50.853531 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:27:50.853531 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:27:50.853531 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:27:50.853531 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:27:50.853531 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:27:50.854692 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:27:50.854692 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:27:50.854692 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:27:50.854692 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:27:50.854692 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:27:50.854692 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:27:50.854692 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:27:50.854692 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:27:50.854692 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:27:50.854692 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:27:50.854692 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:27:50.854692 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application with Lock( Aug 18 19:27:50.854692 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:27:50.854692 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:27:50.854692 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:27:50.854692 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:27:50.855661 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:27:50.855661 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:27:50.855661 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:27:50.855661 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:27:50.855661 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:27:50.855661 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:27:50.855661 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:27:50.855661 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:27:50.855661 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:27:50.855661 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:27:50.855661 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 19:27:50.855661 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:27:50.863853 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 135/277] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Aug 18 19:27:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 19:27:50.864254 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22087261-68ca-4a17-b56b-708c343592df None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:50.886041 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:50.909152 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e94556-9736-4cee-9bfd-56ec1a7a6063 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:50.948490 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de2bbfe-e5bf-41cf-a70d-7b05e9f11a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:50.949089 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de2bbfe-e5bf-41cf-a70d-7b05e9f11a96 None admin] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:50.949360 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de2bbfe-e5bf-41cf-a70d-7b05e9f11a96 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:50.949631 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de2bbfe-e5bf-41cf-a70d-7b05e9f11a96 None admin] PATH_INFO: `/v3/users` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:50.950308 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de2bbfe-e5bf-41cf-a70d-7b05e9f11a96 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:50.951780 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de2bbfe-e5bf-41cf-a70d-7b05e9f11a96 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:50.982997 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22087261-68ca-4a17-b56b-708c343592df None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:51.017188 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5108600b-f26e-4f1d-8c1a-3aa0466a8aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:51.017845 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108600b-f26e-4f1d-8c1a-3aa0466a8aaf None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:51.018128 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108600b-f26e-4f1d-8c1a-3aa0466a8aaf None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:51.018396 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108600b-f26e-4f1d-8c1a-3aa0466a8aaf None admin] PATH_INFO: `/v3/roles` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:51.019051 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5108600b-f26e-4f1d-8c1a-3aa0466a8aaf None admin] RBAC: Adding query filter params (name=member) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:27:51.019356 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5108600b-f26e-4f1d-8c1a-3aa0466a8aaf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:51.020724 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5108600b-f26e-4f1d-8c1a-3aa0466a8aaf None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:51.028731 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 136/278] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Aug 18 19:27:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:27:51.029570 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5108600b-f26e-4f1d-8c1a-3aa0466a8aaf None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:51.044852 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 143/279] 10.222.0.23 () {60 vars in 1132 bytes} [Thu Aug 18 19:27:50 2022] POST /identity/v3/users => generated 293 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 19:27:51.054083 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0797f0c-4f74-454f-98bd-760272671730 None None] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:51.054083 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0797f0c-4f74-454f-98bd-760272671730 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:51.054083 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0797f0c-4f74-454f-98bd-760272671730 None None] PATH_INFO: `/` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:51.054083 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 144/280] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:27:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:27:51.054746 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0797f0c-4f74-454f-98bd-760272671730 None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:51.091764 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:51.117344 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:51.152287 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5108600b-f26e-4f1d-8c1a-3aa0466a8aaf None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:51.170193 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0797f0c-4f74-454f-98bd-760272671730 None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:51.190122 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2663ce7e-ae85-477f-bc76-ec2257aea7c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:51.190778 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2663ce7e-ae85-477f-bc76-ec2257aea7c3 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:51.191058 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2663ce7e-ae85-477f-bc76-ec2257aea7c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:51.191334 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2663ce7e-ae85-477f-bc76-ec2257aea7c3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:51.202890 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2663ce7e-ae85-477f-bc76-ec2257aea7c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:27:51.208689 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b341b44d-31c9-4219-989a-1137cb1b8373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:51.208897 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application [None req-2663ce7e-ae85-477f-bc76-ec2257aea7c3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 19:27:51.208897 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:27:51.208897 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:27:51.208897 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:27:51.208897 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:27:51.208897 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:27:51.208897 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:27:51.208897 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:27:51.208897 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:27:51.208897 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:27:51.208897 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:27:51.208897 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:27:51.208897 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:27:51.208897 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:27:51.208897 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:27:51.208897 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:27:51.209792 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:27:51.209792 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:27:51.209792 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:27:51.209792 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:27:51.209792 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:27:51.209792 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:27:51.209792 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:27:51.209792 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:27:51.209792 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:27:51.209792 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:27:51.209792 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:27:51.209792 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application with Lock( Aug 18 19:27:51.209792 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:27:51.209792 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:27:51.209792 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:27:51.209792 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:27:51.215974 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:27:51.215974 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:27:51.215974 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:27:51.215974 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:27:51.215974 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:27:51.215974 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:27:51.215974 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:27:51.215974 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:27:51.215974 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:27:51.215974 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:27:51.215974 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 19:27:51.215974 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:27:51.216599 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b341b44d-31c9-4219-989a-1137cb1b8373 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:51.216599 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b341b44d-31c9-4219-989a-1137cb1b8373 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:51.216599 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b341b44d-31c9-4219-989a-1137cb1b8373 None admin] PATH_INFO: `/v3/users/0f55906cd00148b99cfe367083175528` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:51.216779 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 137/281] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Aug 18 19:27:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:27:51.216779 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f904e-09f0-49fd-9daa-84ad9f575d09 None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:51.216779 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f904e-09f0-49fd-9daa-84ad9f575d09 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:51.216779 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f904e-09f0-49fd-9daa-84ad9f575d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:51.231760 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b341b44d-31c9-4219-989a-1137cb1b8373 None admin] RBAC: Authorizing `identity:get_user(user_id=0f55906cd00148b99cfe367083175528)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:51.233229 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b341b44d-31c9-4219-989a-1137cb1b8373 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:51.235061 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-1f2f904e-09f0-49fd-9daa-84ad9f575d09 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:27:51.235279 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 145/282] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Aug 18 19:27:51 2022] GET /identity/v3/users/0f55906cd00148b99cfe367083175528 => generated 293 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:27:51.236430 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b341b44d-31c9-4219-989a-1137cb1b8373 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:51.240722 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-1f2f904e-09f0-49fd-9daa-84ad9f575d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:27:51.318516 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 138/283] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:27:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:27:51.319278 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2f904e-09f0-49fd-9daa-84ad9f575d09 None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:51.344361 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:51.362696 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b341b44d-31c9-4219-989a-1137cb1b8373 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:51.397276 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:51.405553 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeb4d3f-22e2-4102-8071-eaae5d6cb6fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:51.406233 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb4d3f-22e2-4102-8071-eaae5d6cb6fc None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:51.406512 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb4d3f-22e2-4102-8071-eaae5d6cb6fc None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:51.406785 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb4d3f-22e2-4102-8071-eaae5d6cb6fc None admin] PATH_INFO: `/v3/roles` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:51.407541 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeb4d3f-22e2-4102-8071-eaae5d6cb6fc None admin] RBAC: Adding query filter params (name=reader) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:27:51.407809 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeb4d3f-22e2-4102-8071-eaae5d6cb6fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:51.410376 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeb4d3f-22e2-4102-8071-eaae5d6cb6fc None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:51.418650 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 146/284] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Aug 18 19:27:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:27:51.426181 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeb4d3f-22e2-4102-8071-eaae5d6cb6fc None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:51.445637 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2f904e-09f0-49fd-9daa-84ad9f575d09 None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:51.484153 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbff5aff-2eee-4158-8408-05c7dc4d5c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:51.484757 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbff5aff-2eee-4158-8408-05c7dc4d5c09 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:51.485033 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbff5aff-2eee-4158-8408-05c7dc4d5c09 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:51.485885 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbff5aff-2eee-4158-8408-05c7dc4d5c09 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:51.486607 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbff5aff-2eee-4158-8408-05c7dc4d5c09 None admin] RBAC: Adding query filter params (role.id=ece5eb2bd1334192b3eee1b7b05c042c, user.id=0f55906cd00148b99cfe367083175528, scope.system=all) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:27:51.486959 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbff5aff-2eee-4158-8408-05c7dc4d5c09 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:51.488456 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbff5aff-2eee-4158-8408-05c7dc4d5c09 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:51.494303 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 139/285] 10.222.0.23 () {56 vars in 1308 bytes} [Thu Aug 18 19:27:51 2022] GET /identity/v3/role_assignments?user.id=0f55906cd00148b99cfe367083175528&scope.system=all&role.id=ece5eb2bd1334192b3eee1b7b05c042c => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:27:51.565787 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeb4d3f-22e2-4102-8071-eaae5d6cb6fc None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:51.606410 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693dcf9d-c3a6-4670-85a3-a07bd0c344ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:51.607295 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693dcf9d-c3a6-4670-85a3-a07bd0c344ec None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:51.607781 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693dcf9d-c3a6-4670-85a3-a07bd0c344ec None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:51.608200 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693dcf9d-c3a6-4670-85a3-a07bd0c344ec None admin] PATH_INFO: `/v3/users/2d09a921ef944be09a500c5d25fd55f7` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:51.609597 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693dcf9d-c3a6-4670-85a3-a07bd0c344ec None admin] RBAC: Authorizing `identity:get_user(user_id=2d09a921ef944be09a500c5d25fd55f7)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:51.611785 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693dcf9d-c3a6-4670-85a3-a07bd0c344ec None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:51.613998 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 147/286] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Aug 18 19:27:51 2022] GET /identity/v3/users/2d09a921ef944be09a500c5d25fd55f7 => generated 297 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:27:51.619489 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbff5aff-2eee-4158-8408-05c7dc4d5c09 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:51.693930 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693dcf9d-c3a6-4670-85a3-a07bd0c344ec None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:51.717685 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:51.776039 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbff5aff-2eee-4158-8408-05c7dc4d5c09 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:51.829343 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:51.842918 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29435a4c-03b4-4ecc-96cd-e06cba575ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:51.843641 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29435a4c-03b4-4ecc-96cd-e06cba575ac6 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:51.843978 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29435a4c-03b4-4ecc-96cd-e06cba575ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:51.844250 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29435a4c-03b4-4ecc-96cd-e06cba575ac6 None admin] PATH_INFO: `/v3/projects/f04621419eb84b00a435d700f145cf48` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:51.846081 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29435a4c-03b4-4ecc-96cd-e06cba575ac6 None admin] RBAC: Authorizing `identity:get_project(project_id=f04621419eb84b00a435d700f145cf48)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:51.847511 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29435a4c-03b4-4ecc-96cd-e06cba575ac6 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:51.849330 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 140/287] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Aug 18 19:27:51 2022] GET /identity/v3/projects/f04621419eb84b00a435d700f145cf48 => generated 302 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:27:51.855269 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29435a4c-03b4-4ecc-96cd-e06cba575ac6 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:51.878100 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693dcf9d-c3a6-4670-85a3-a07bd0c344ec None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:51.915341 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559ab993-5e1d-487a-b032-b117aad94c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:51.916441 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559ab993-5e1d-487a-b032-b117aad94c6e None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:51.916932 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559ab993-5e1d-487a-b032-b117aad94c6e None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:51.917449 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559ab993-5e1d-487a-b032-b117aad94c6e None admin] PATH_INFO: `/v3/roles/member` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:51.928944 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559ab993-5e1d-487a-b032-b117aad94c6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:27:51.934896 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application [None req-559ab993-5e1d-487a-b032-b117aad94c6e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 19:27:51.934896 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:27:51.934896 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:27:51.934896 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:27:51.934896 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:27:51.934896 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:27:51.934896 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:27:51.934896 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:27:51.934896 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:27:51.934896 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:27:51.934896 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:27:51.934896 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:27:51.934896 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:27:51.934896 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:27:51.934896 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:27:51.934896 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:27:51.935795 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:27:51.935795 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:27:51.935795 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:27:51.935795 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:27:51.935795 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:27:51.935795 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:27:51.935795 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:27:51.935795 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:27:51.935795 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:27:51.935795 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:27:51.935795 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:27:51.935795 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application with Lock( Aug 18 19:27:51.935795 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:27:51.935795 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:27:51.935795 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:27:51.935795 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:27:51.936575 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:27:51.936575 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:27:51.936575 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:27:51.936575 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:27:51.936575 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:27:51.936575 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:27:51.936575 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:27:51.936575 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:27:51.936575 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:27:51.936575 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:27:51.936575 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 19:27:51.936575 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:27:51.939056 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 148/288] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Aug 18 19:27:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 19:27:51.946764 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559ab993-5e1d-487a-b032-b117aad94c6e None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:52.047576 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29435a4c-03b4-4ecc-96cd-e06cba575ac6 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:52.087346 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:52.119484 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d247a0-6538-4f71-a6cb-0e6b2c6bf598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:52.120199 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d247a0-6538-4f71-a6cb-0e6b2c6bf598 None admin] REQUEST_METHOD: `PUT` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:52.120477 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d247a0-6538-4f71-a6cb-0e6b2c6bf598 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:52.120745 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d247a0-6538-4f71-a6cb-0e6b2c6bf598 None admin] PATH_INFO: `/v3/projects/f04621419eb84b00a435d700f145cf48/users/2d09a921ef944be09a500c5d25fd55f7/roles/9aa2d4ac6d7540c68a34e8ffba0e545d` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:52.123489 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559ab993-5e1d-487a-b032-b117aad94c6e None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:52.126743 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d247a0-6538-4f71-a6cb-0e6b2c6bf598 None admin] RBAC: Authorizing `identity:create_grant(project_id=f04621419eb84b00a435d700f145cf48, user_id=2d09a921ef944be09a500c5d25fd55f7, role_id=9aa2d4ac6d7540c68a34e8ffba0e545d)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:52.128253 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d247a0-6538-4f71-a6cb-0e6b2c6bf598 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:52.164154 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0232cd-66ed-432c-ab5b-b611cc5d33bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:52.164771 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0232cd-66ed-432c-ab5b-b611cc5d33bb None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:52.165049 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0232cd-66ed-432c-ab5b-b611cc5d33bb None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:52.165319 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0232cd-66ed-432c-ab5b-b611cc5d33bb None admin] PATH_INFO: `/v3/roles` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:52.166071 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0232cd-66ed-432c-ab5b-b611cc5d33bb None admin] RBAC: Adding query filter params (name=member) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:27:52.166631 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0232cd-66ed-432c-ab5b-b611cc5d33bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:52.168030 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0232cd-66ed-432c-ab5b-b611cc5d33bb None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:52.177681 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 149/289] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Aug 18 19:27:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:27:52.183303 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0232cd-66ed-432c-ab5b-b611cc5d33bb None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:52.217013 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 141/290] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Aug 18 19:27:51 2022] PUT /identity/v3/projects/f04621419eb84b00a435d700f145cf48/users/2d09a921ef944be09a500c5d25fd55f7/roles/9aa2d4ac6d7540c68a34e8ffba0e545d => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 19:27:52.323824 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0232cd-66ed-432c-ab5b-b611cc5d33bb None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:52.372057 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33057d99-3cfb-482f-94d7-89fe2eaebca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:52.372715 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33057d99-3cfb-482f-94d7-89fe2eaebca8 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:52.372996 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33057d99-3cfb-482f-94d7-89fe2eaebca8 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:52.373267 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33057d99-3cfb-482f-94d7-89fe2eaebca8 None admin] PATH_INFO: `/v3/users/aa80cee4e7214072bbc6d4464d4756f2` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:52.374584 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33057d99-3cfb-482f-94d7-89fe2eaebca8 None admin] RBAC: Authorizing `identity:get_user(user_id=aa80cee4e7214072bbc6d4464d4756f2)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:52.376239 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33057d99-3cfb-482f-94d7-89fe2eaebca8 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:52.378196 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 150/291] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Aug 18 19:27:52 2022] GET /identity/v3/users/aa80cee4e7214072bbc6d4464d4756f2 => generated 297 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:27:52.384051 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d247a0-6538-4f71-a6cb-0e6b2c6bf598 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:52.446125 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:52.497677 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d247a0-6538-4f71-a6cb-0e6b2c6bf598 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:52.536274 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481281bd-db3a-40ec-b233-2af90cf7370e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:52.536883 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481281bd-db3a-40ec-b233-2af90cf7370e None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:52.537164 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481281bd-db3a-40ec-b233-2af90cf7370e None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:52.537441 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481281bd-db3a-40ec-b233-2af90cf7370e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:52.614527 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481281bd-db3a-40ec-b233-2af90cf7370e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:52.616014 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481281bd-db3a-40ec-b233-2af90cf7370e None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:52.675025 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:52.723848 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 142/292] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Aug 18 19:27:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 19:27:52.729578 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33057d99-3cfb-482f-94d7-89fe2eaebca8 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:52.739873 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:52.860935 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33057d99-3cfb-482f-94d7-89fe2eaebca8 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:52.903437 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8138f9-032b-49f0-adac-98221d5a5817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:52.904470 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8138f9-032b-49f0-adac-98221d5a5817 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:52.904964 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8138f9-032b-49f0-adac-98221d5a5817 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:52.905435 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8138f9-032b-49f0-adac-98221d5a5817 None admin] PATH_INFO: `/v3/projects/f04621419eb84b00a435d700f145cf48` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:52.910328 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8138f9-032b-49f0-adac-98221d5a5817 None admin] RBAC: Authorizing `identity:get_project(project_id=f04621419eb84b00a435d700f145cf48)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:52.911998 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8138f9-032b-49f0-adac-98221d5a5817 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:52.914221 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 151/293] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Aug 18 19:27:52 2022] GET /identity/v3/projects/f04621419eb84b00a435d700f145cf48 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:27:52.919695 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481281bd-db3a-40ec-b233-2af90cf7370e None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:53.077959 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481281bd-db3a-40ec-b233-2af90cf7370e None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:53.114581 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999b1eb1-569c-4aa0-933a-5cfa298d1033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:53.118407 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999b1eb1-569c-4aa0-933a-5cfa298d1033 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:53.118407 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999b1eb1-569c-4aa0-933a-5cfa298d1033 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:53.118407 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999b1eb1-569c-4aa0-933a-5cfa298d1033 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:53.118407 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999b1eb1-569c-4aa0-933a-5cfa298d1033 None admin] RBAC: Adding query filter params (role.id=ece5eb2bd1334192b3eee1b7b05c042c, scope.project.id=f04621419eb84b00a435d700f145cf48, user.id=aa80cee4e7214072bbc6d4464d4756f2) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:27:53.118407 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999b1eb1-569c-4aa0-933a-5cfa298d1033 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:53.118407 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999b1eb1-569c-4aa0-933a-5cfa298d1033 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:53.124524 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 143/294] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Aug 18 19:27:52 2022] GET /identity/v3/role_assignments?user.id=aa80cee4e7214072bbc6d4464d4756f2&scope.project.id=f04621419eb84b00a435d700f145cf48&role.id=ece5eb2bd1334192b3eee1b7b05c042c => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:27:53.811412 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126e1bbc-2f6a-402d-85cd-0b19ca794d3a None None] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:53.811917 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126e1bbc-2f6a-402d-85cd-0b19ca794d3a None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:53.812034 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126e1bbc-2f6a-402d-85cd-0b19ca794d3a None None] PATH_INFO: `/` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:53.813470 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 152/295] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:27:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:27:53.819134 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c21e536-4df3-4b61-b7d4-3f380032f4c4 None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:53.819658 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c21e536-4df3-4b61-b7d4-3f380032f4c4 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:53.820131 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c21e536-4df3-4b61-b7d4-3f380032f4c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:53.841292 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-8c21e536-4df3-4b61-b7d4-3f380032f4c4 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:27:53.842972 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-8c21e536-4df3-4b61-b7d4-3f380032f4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:27:53.858444 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:53.925322 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 144/296] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:27:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:27:53.971328 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c52c45-55d9-4d75-a9bf-421c65e4039a None None] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:53.971672 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c52c45-55d9-4d75-a9bf-421c65e4039a None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:53.971878 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c52c45-55d9-4d75-a9bf-421c65e4039a None None] PATH_INFO: `/` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:53.973230 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 153/297] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:27:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:27:53.978966 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70847d49-b20e-422b-a6f9-fe9cce1f0e41 None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:53.979255 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70847d49-b20e-422b-a6f9-fe9cce1f0e41 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:53.979532 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70847d49-b20e-422b-a6f9-fe9cce1f0e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:53.998353 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-70847d49-b20e-422b-a6f9-fe9cce1f0e41 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:27:53.999531 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-70847d49-b20e-422b-a6f9-fe9cce1f0e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:27:54.077693 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 145/298] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:27:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:27:54.110839 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3d67f-1617-4f24-b1b2-ebeeb5df4919 None None] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:54.111124 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3d67f-1617-4f24-b1b2-ebeeb5df4919 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:54.111400 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3d67f-1617-4f24-b1b2-ebeeb5df4919 None None] PATH_INFO: `/` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:54.112851 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 154/299] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:27:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:27:54.121112 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e94650-1d02-4e29-998f-41b441d449e3 None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:54.121112 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e94650-1d02-4e29-998f-41b441d449e3 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:54.121112 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e94650-1d02-4e29-998f-41b441d449e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:54.137753 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-50e94650-1d02-4e29-998f-41b441d449e3 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:27:54.139081 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-50e94650-1d02-4e29-998f-41b441d449e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:27:54.206462 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 146/300] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:27:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:27:54.272296 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de3d67f-1617-4f24-b1b2-ebeeb5df4919 None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:54.351331 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:54.377457 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de3d67f-1617-4f24-b1b2-ebeeb5df4919 None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:54.412562 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cff77c-633a-4b91-a9cf-8df33b7a334e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:54.413194 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cff77c-633a-4b91-a9cf-8df33b7a334e None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:54.413476 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cff77c-633a-4b91-a9cf-8df33b7a334e None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:54.413782 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cff77c-633a-4b91-a9cf-8df33b7a334e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:54.424879 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cff77c-633a-4b91-a9cf-8df33b7a334e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:27:54.427156 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e94650-1d02-4e29-998f-41b441d449e3 None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:54.430281 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application [None req-85cff77c-633a-4b91-a9cf-8df33b7a334e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 19:27:54.430281 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:27:54.430281 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:27:54.430281 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:27:54.430281 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:27:54.430281 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:27:54.430281 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:27:54.430281 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:27:54.430281 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:27:54.430281 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:27:54.430281 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:27:54.430281 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:27:54.430281 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:27:54.430281 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:27:54.430281 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:27:54.430281 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:27:54.431133 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:27:54.431133 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:27:54.431133 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:27:54.431133 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:27:54.431133 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:27:54.431133 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:27:54.431133 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:27:54.431133 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:27:54.431133 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:27:54.431133 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:27:54.431133 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:27:54.431133 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application with Lock( Aug 18 19:27:54.431133 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:27:54.431133 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:27:54.431133 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:27:54.431133 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:27:54.431905 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:27:54.431905 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:27:54.431905 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:27:54.431905 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:27:54.431905 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:27:54.431905 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:27:54.431905 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:27:54.431905 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:27:54.431905 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:27:54.431905 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:27:54.431905 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 19:27:54.431905 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:27:54.431905 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 155/301] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Aug 18 19:27:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:27:54.436918 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cff77c-633a-4b91-a9cf-8df33b7a334e None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:54.438705 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:54.548997 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cff77c-633a-4b91-a9cf-8df33b7a334e None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:54.553828 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e94650-1d02-4e29-998f-41b441d449e3 None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:54.586063 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af47055-7930-4e29-8584-6d745d270958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:54.586680 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af47055-7930-4e29-8584-6d745d270958 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:54.586962 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af47055-7930-4e29-8584-6d745d270958 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:54.587233 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af47055-7930-4e29-8584-6d745d270958 None admin] PATH_INFO: `/v3/roles` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:54.588148 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af47055-7930-4e29-8584-6d745d270958 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:27:54.588449 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af47055-7930-4e29-8584-6d745d270958 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:54.589854 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af47055-7930-4e29-8584-6d745d270958 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:54.591304 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:54.591724 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374e4ab6-84d9-4bb5-8fd4-e327cd7e8367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:54.592708 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e4ab6-84d9-4bb5-8fd4-e327cd7e8367 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:54.593065 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e4ab6-84d9-4bb5-8fd4-e327cd7e8367 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:54.593268 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e4ab6-84d9-4bb5-8fd4-e327cd7e8367 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:54.594419 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374e4ab6-84d9-4bb5-8fd4-e327cd7e8367 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:54.595829 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374e4ab6-84d9-4bb5-8fd4-e327cd7e8367 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:54.607648 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 147/302] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Aug 18 19:27:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:27:54.607648 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374e4ab6-84d9-4bb5-8fd4-e327cd7e8367 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:54.607865 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 156/303] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Aug 18 19:27:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:27:54.607865 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af47055-7930-4e29-8584-6d745d270958 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:54.687024 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:54.711487 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374e4ab6-84d9-4bb5-8fd4-e327cd7e8367 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:54.713867 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af47055-7930-4e29-8584-6d745d270958 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:54.749508 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744c5003-1299-443c-878b-94480ef17d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:54.750282 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c5003-1299-443c-878b-94480ef17d37 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:54.750681 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c5003-1299-443c-878b-94480ef17d37 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:54.751511 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c5003-1299-443c-878b-94480ef17d37 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:54.751695 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130d1f6c-bf40-47bf-90db-06b9952d1a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:54.752302 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d1f6c-bf40-47bf-90db-06b9952d1a05 None admin] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:54.752583 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d1f6c-bf40-47bf-90db-06b9952d1a05 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:54.752857 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d1f6c-bf40-47bf-90db-06b9952d1a05 None admin] PATH_INFO: `/v3/groups` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:54.753544 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130d1f6c-bf40-47bf-90db-06b9952d1a05 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:54.755081 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130d1f6c-bf40-47bf-90db-06b9952d1a05 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:54.762899 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744c5003-1299-443c-878b-94480ef17d37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:27:54.767780 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application [None req-744c5003-1299-443c-878b-94480ef17d37 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 19:27:54.767780 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:27:54.767780 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:27:54.767780 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:27:54.767780 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:27:54.767780 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:27:54.767780 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:27:54.767780 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:27:54.767780 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:27:54.767780 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:27:54.767780 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:27:54.767780 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:27:54.767780 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:27:54.767780 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:27:54.767780 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:27:54.767780 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:27:54.783042 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:27:54.783042 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:27:54.783042 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:27:54.783042 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:27:54.783042 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:27:54.783042 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:27:54.783042 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:27:54.783042 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:27:54.783042 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:27:54.783042 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:27:54.783042 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:27:54.783042 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application with Lock( Aug 18 19:27:54.783042 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:27:54.783042 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:27:54.783042 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:27:54.783042 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:27:54.783897 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:27:54.783897 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:27:54.783897 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:27:54.783897 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:27:54.783897 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:27:54.783897 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:27:54.783897 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:27:54.783897 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:27:54.783897 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:27:54.783897 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:27:54.783897 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 19:27:54.783897 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:27:54.783897 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 148/304] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Aug 18 19:27:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:27:54.783897 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744c5003-1299-443c-878b-94480ef17d37 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:54.864713 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 157/305] 10.222.0.23 () {60 vars in 1134 bytes} [Thu Aug 18 19:27:54 2022] POST /identity/v3/groups => generated 229 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 19:27:54.866524 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130d1f6c-bf40-47bf-90db-06b9952d1a05 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:54.889956 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744c5003-1299-443c-878b-94480ef17d37 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:54.930367 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce7169c-34fc-4a85-98b5-b60774935659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:54.931141 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7169c-34fc-4a85-98b5-b60774935659 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:54.931478 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7169c-34fc-4a85-98b5-b60774935659 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:54.931802 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7169c-34fc-4a85-98b5-b60774935659 None admin] PATH_INFO: `/v3/users/f1e6874c4886424789879eecdb6c7e16` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:54.937080 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:54.950019 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce7169c-34fc-4a85-98b5-b60774935659 None admin] RBAC: Authorizing `identity:get_user(user_id=f1e6874c4886424789879eecdb6c7e16)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:54.951764 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce7169c-34fc-4a85-98b5-b60774935659 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:54.953735 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 149/306] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Aug 18 19:27:54 2022] GET /identity/v3/users/f1e6874c4886424789879eecdb6c7e16 => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:27:54.959693 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce7169c-34fc-4a85-98b5-b60774935659 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:54.964390 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:55.036569 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130d1f6c-bf40-47bf-90db-06b9952d1a05 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:55.079245 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d02017-a506-422c-b172-d2dfd1ea91b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:55.079245 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d02017-a506-422c-b172-d2dfd1ea91b6 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:55.079245 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d02017-a506-422c-b172-d2dfd1ea91b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:55.079574 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d02017-a506-422c-b172-d2dfd1ea91b6 None admin] PATH_INFO: `/v3/roles` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:55.080123 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d02017-a506-422c-b172-d2dfd1ea91b6 None admin] RBAC: Adding query filter params (name=member) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:27:55.080434 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d02017-a506-422c-b172-d2dfd1ea91b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:55.081995 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d02017-a506-422c-b172-d2dfd1ea91b6 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:55.091733 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 158/307] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Aug 18 19:27:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:27:55.093289 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6accbd65-def5-4b29-afc3-4145b86f4ff0 None None] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:55.093904 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6accbd65-def5-4b29-afc3-4145b86f4ff0 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:55.094783 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6accbd65-def5-4b29-afc3-4145b86f4ff0 None None] PATH_INFO: `/` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:55.096236 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 159/308] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:27:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:27:55.098159 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6accbd65-def5-4b29-afc3-4145b86f4ff0 None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:55.101152 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce7169c-34fc-4a85-98b5-b60774935659 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:55.137307 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5722bf53-d5fe-45ca-84d3-c3976bbc1c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:55.137874 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5722bf53-d5fe-45ca-84d3-c3976bbc1c7a None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:55.138173 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5722bf53-d5fe-45ca-84d3-c3976bbc1c7a None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:55.138425 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5722bf53-d5fe-45ca-84d3-c3976bbc1c7a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:55.139138 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5722bf53-d5fe-45ca-84d3-c3976bbc1c7a None admin] RBAC: Adding query filter params (role.id=9aa2d4ac6d7540c68a34e8ffba0e545d, user.id=f1e6874c4886424789879eecdb6c7e16, scope.system=all) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:27:55.139446 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5722bf53-d5fe-45ca-84d3-c3976bbc1c7a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:55.141315 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5722bf53-d5fe-45ca-84d3-c3976bbc1c7a None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:55.146558 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 150/309] 10.222.0.23 () {56 vars in 1308 bytes} [Thu Aug 18 19:27:54 2022] GET /identity/v3/role_assignments?user.id=f1e6874c4886424789879eecdb6c7e16&scope.system=all&role.id=9aa2d4ac6d7540c68a34e8ffba0e545d => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:27:55.147715 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2763853-4e59-470a-b511-2ce088024550 None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:55.152870 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2763853-4e59-470a-b511-2ce088024550 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:55.152870 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2763853-4e59-470a-b511-2ce088024550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:55.182948 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-f2763853-4e59-470a-b511-2ce088024550 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:27:55.185766 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-f2763853-4e59-470a-b511-2ce088024550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:27:55.231569 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6accbd65-def5-4b29-afc3-4145b86f4ff0 None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:55.254477 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:55.261057 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:55.275151 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d6f45b-7fc4-4e8d-8f0b-f499ca61e7f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:55.275902 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d6f45b-7fc4-4e8d-8f0b-f499ca61e7f5 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:55.276251 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d6f45b-7fc4-4e8d-8f0b-f499ca61e7f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:55.276600 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d6f45b-7fc4-4e8d-8f0b-f499ca61e7f5 None admin] PATH_INFO: `/v3/users/0f55906cd00148b99cfe367083175528` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:55.278219 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d6f45b-7fc4-4e8d-8f0b-f499ca61e7f5 None admin] RBAC: Authorizing `identity:get_user(user_id=0f55906cd00148b99cfe367083175528)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:55.279458 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d6f45b-7fc4-4e8d-8f0b-f499ca61e7f5 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:55.281703 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 160/310] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Aug 18 19:27:55 2022] GET /identity/v3/users/0f55906cd00148b99cfe367083175528 => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:27:55.288654 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d6f45b-7fc4-4e8d-8f0b-f499ca61e7f5 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:55.289302 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 151/311] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:27:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:27:55.401985 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d6f45b-7fc4-4e8d-8f0b-f499ca61e7f5 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:55.436903 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9b85e1-de98-468b-9086-a46d11b1f596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:55.437563 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b85e1-de98-468b-9086-a46d11b1f596 None admin] REQUEST_METHOD: `PUT` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:55.437884 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b85e1-de98-468b-9086-a46d11b1f596 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:55.438204 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b85e1-de98-468b-9086-a46d11b1f596 None admin] PATH_INFO: `/v3/system/users/0f55906cd00148b99cfe367083175528/roles/ece5eb2bd1334192b3eee1b7b05c042c` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:55.439597 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9b85e1-de98-468b-9086-a46d11b1f596 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=0f55906cd00148b99cfe367083175528, role_id=ece5eb2bd1334192b3eee1b7b05c042c)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:55.441006 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9b85e1-de98-468b-9086-a46d11b1f596 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:55.548095 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 161/312] 10.222.0.23 () {58 vars in 1334 bytes} [Thu Aug 18 19:27:55 2022] PUT /identity/v3/system/users/0f55906cd00148b99cfe367083175528/roles/ece5eb2bd1334192b3eee1b7b05c042c => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 19:27:55.617551 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2763853-4e59-470a-b511-2ce088024550 None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:55.735132 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2763853-4e59-470a-b511-2ce088024550 None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:55.771097 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2e0c89-39a8-4381-aa0f-c0d7bc0798df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:55.772063 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2e0c89-39a8-4381-aa0f-c0d7bc0798df None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:55.772542 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2e0c89-39a8-4381-aa0f-c0d7bc0798df None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:55.773035 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2e0c89-39a8-4381-aa0f-c0d7bc0798df None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:55.784057 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2e0c89-39a8-4381-aa0f-c0d7bc0798df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:27:55.789341 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application [None req-9b2e0c89-39a8-4381-aa0f-c0d7bc0798df None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 19:27:55.789341 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:27:55.789341 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:27:55.789341 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:27:55.789341 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:27:55.789341 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:27:55.789341 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:27:55.789341 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:27:55.789341 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:27:55.789341 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:27:55.789341 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:27:55.789341 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:27:55.789341 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:27:55.789341 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:27:55.789341 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:27:55.789341 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:27:55.790250 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:27:55.790250 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:27:55.790250 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:27:55.790250 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:27:55.790250 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:27:55.790250 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:27:55.790250 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:27:55.790250 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:27:55.790250 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:27:55.790250 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:27:55.790250 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:27:55.790250 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application with Lock( Aug 18 19:27:55.790250 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:27:55.790250 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:27:55.790250 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:27:55.790250 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:27:55.791032 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:27:55.791032 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:27:55.791032 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:27:55.791032 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:27:55.791032 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:27:55.791032 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:27:55.791032 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:27:55.791032 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:27:55.791032 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:27:55.791032 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:27:55.791032 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 19:27:55.791032 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:27:55.793623 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 152/313] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Aug 18 19:27:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:27:55.801761 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9b85e1-de98-468b-9086-a46d11b1f596 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:55.852891 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:55.904296 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9b85e1-de98-468b-9086-a46d11b1f596 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:55.939684 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4934fcf-4606-4335-872d-94a3156b02a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:55.940298 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4934fcf-4606-4335-872d-94a3156b02a2 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:55.940579 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4934fcf-4606-4335-872d-94a3156b02a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:55.940851 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4934fcf-4606-4335-872d-94a3156b02a2 None admin] PATH_INFO: `/v3/roles` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:55.941505 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4934fcf-4606-4335-872d-94a3156b02a2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:27:55.941842 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4934fcf-4606-4335-872d-94a3156b02a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:55.943229 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4934fcf-4606-4335-872d-94a3156b02a2 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:55.951919 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 162/314] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Aug 18 19:27:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:27:55.957274 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2e0c89-39a8-4381-aa0f-c0d7bc0798df None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:56.022043 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:56.064166 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2e0c89-39a8-4381-aa0f-c0d7bc0798df None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:56.102355 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dcc4a3-0cdc-4cce-8fae-ae9421954556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:56.103015 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dcc4a3-0cdc-4cce-8fae-ae9421954556 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:56.103295 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dcc4a3-0cdc-4cce-8fae-ae9421954556 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:56.103566 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dcc4a3-0cdc-4cce-8fae-ae9421954556 None admin] PATH_INFO: `/v3/users/2d09a921ef944be09a500c5d25fd55f7` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:56.104836 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dcc4a3-0cdc-4cce-8fae-ae9421954556 None admin] RBAC: Authorizing `identity:get_user(user_id=2d09a921ef944be09a500c5d25fd55f7)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:56.106380 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dcc4a3-0cdc-4cce-8fae-ae9421954556 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:56.108420 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 153/315] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Aug 18 19:27:55 2022] GET /identity/v3/users/2d09a921ef944be09a500c5d25fd55f7 => generated 297 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:27:56.114713 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4934fcf-4606-4335-872d-94a3156b02a2 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:56.225822 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4934fcf-4606-4335-872d-94a3156b02a2 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:56.240214 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:56.262354 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2505952-b276-4256-95d5-3f20051c02e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:56.262974 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2505952-b276-4256-95d5-3f20051c02e7 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:56.263266 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2505952-b276-4256-95d5-3f20051c02e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:56.263522 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2505952-b276-4256-95d5-3f20051c02e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:56.339578 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2505952-b276-4256-95d5-3f20051c02e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:56.340987 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2505952-b276-4256-95d5-3f20051c02e7 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:56.445085 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 163/316] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Aug 18 19:27:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 19:27:56.451172 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dcc4a3-0cdc-4cce-8fae-ae9421954556 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:56.552760 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dcc4a3-0cdc-4cce-8fae-ae9421954556 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:56.569353 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:56.586746 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a82493-8e20-4a74-a3e3-a0d132689810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:56.587380 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a82493-8e20-4a74-a3e3-a0d132689810 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:56.587660 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a82493-8e20-4a74-a3e3-a0d132689810 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:56.588194 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a82493-8e20-4a74-a3e3-a0d132689810 None admin] PATH_INFO: `/v3/projects/f04621419eb84b00a435d700f145cf48` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:56.589349 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a82493-8e20-4a74-a3e3-a0d132689810 None admin] RBAC: Authorizing `identity:get_project(project_id=f04621419eb84b00a435d700f145cf48)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:56.590872 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a82493-8e20-4a74-a3e3-a0d132689810 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:56.596333 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 154/317] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Aug 18 19:27:56 2022] GET /identity/v3/projects/f04621419eb84b00a435d700f145cf48 => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:27:56.599450 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2505952-b276-4256-95d5-3f20051c02e7 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:56.615820 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:56.704798 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2505952-b276-4256-95d5-3f20051c02e7 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:56.742978 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfab073f-37df-4d89-88cf-2bd7293d95e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:56.743950 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfab073f-37df-4d89-88cf-2bd7293d95e2 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:56.744423 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfab073f-37df-4d89-88cf-2bd7293d95e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:56.744914 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfab073f-37df-4d89-88cf-2bd7293d95e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:56.745866 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfab073f-37df-4d89-88cf-2bd7293d95e2 None admin] RBAC: Adding query filter params (role.id=9aa2d4ac6d7540c68a34e8ffba0e545d, scope.project.id=f04621419eb84b00a435d700f145cf48, user.id=2d09a921ef944be09a500c5d25fd55f7) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:27:56.746372 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfab073f-37df-4d89-88cf-2bd7293d95e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:56.748106 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfab073f-37df-4d89-88cf-2bd7293d95e2 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:56.754907 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 164/318] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Aug 18 19:27:56 2022] GET /identity/v3/role_assignments?user.id=2d09a921ef944be09a500c5d25fd55f7&scope.project.id=f04621419eb84b00a435d700f145cf48&role.id=9aa2d4ac6d7540c68a34e8ffba0e545d => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:27:57.225952 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed76f42-ba79-4a00-87f8-75ccc982b65f None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:57.226988 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed76f42-ba79-4a00-87f8-75ccc982b65f None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:57.227474 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed76f42-ba79-4a00-87f8-75ccc982b65f None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:57.230153 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 155/319] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:27:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:27:57.235212 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664bd216-34af-40d5-9bcc-18b4be4ad354 None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:57.236007 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664bd216-34af-40d5-9bcc-18b4be4ad354 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:57.236477 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664bd216-34af-40d5-9bcc-18b4be4ad354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:57.255409 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-664bd216-34af-40d5-9bcc-18b4be4ad354 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:27:57.256921 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-664bd216-34af-40d5-9bcc-18b4be4ad354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:27:57.332440 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 165/320] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:27:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:27:57.447398 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec5acb0-57d3-4e3d-9ad3-c16e701eb1fd None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:57.447702 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec5acb0-57d3-4e3d-9ad3-c16e701eb1fd None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:57.447948 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec5acb0-57d3-4e3d-9ad3-c16e701eb1fd None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:57.449472 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 156/321] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:27:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:27:57.454556 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b1a356-5f27-4410-b7ef-569fed7299de None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:57.454841 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b1a356-5f27-4410-b7ef-569fed7299de None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:57.455111 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b1a356-5f27-4410-b7ef-569fed7299de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:57.468519 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:57.474519 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-48b1a356-5f27-4410-b7ef-569fed7299de None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:27:57.475723 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-48b1a356-5f27-4410-b7ef-569fed7299de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:27:57.548850 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 166/322] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:27:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:27:57.663762 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec5acb0-57d3-4e3d-9ad3-c16e701eb1fd None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:57.771264 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec5acb0-57d3-4e3d-9ad3-c16e701eb1fd None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:57.805730 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3e09cd-6750-42f0-8b65-c8d44ce6a7a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:57.806386 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e09cd-6750-42f0-8b65-c8d44ce6a7a3 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:57.806660 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e09cd-6750-42f0-8b65-c8d44ce6a7a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:57.806935 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e09cd-6750-42f0-8b65-c8d44ce6a7a3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:57.808032 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3e09cd-6750-42f0-8b65-c8d44ce6a7a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:57.809494 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3e09cd-6750-42f0-8b65-c8d44ce6a7a3 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:57.811253 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 157/323] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Aug 18 19:27:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:27:57.816772 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b1a356-5f27-4410-b7ef-569fed7299de None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:57.834302 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa065d8f-a0f0-4567-8e78-9b61234ce67c None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:57.834588 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa065d8f-a0f0-4567-8e78-9b61234ce67c None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:57.834860 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa065d8f-a0f0-4567-8e78-9b61234ce67c None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:57.836196 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 158/324] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:27:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 19:27:57.841690 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa651e-2b22-4c36-b95c-b77c1493c3de None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:57.842003 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa651e-2b22-4c36-b95c-b77c1493c3de None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:57.842281 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa651e-2b22-4c36-b95c-b77c1493c3de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:57.861374 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-f1aa651e-2b22-4c36-b95c-b77c1493c3de None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:27:57.862592 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-f1aa651e-2b22-4c36-b95c-b77c1493c3de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:27:57.911131 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:57.919617 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b1a356-5f27-4410-b7ef-569fed7299de None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:57.930527 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 159/325] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:27:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 19:27:57.931601 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aa651e-2b22-4c36-b95c-b77c1493c3de None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:57.957137 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4486228-9c81-4e2b-bd2f-c7d5547b0dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:57.957782 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4486228-9c81-4e2b-bd2f-c7d5547b0dca None admin] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:57.958058 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4486228-9c81-4e2b-bd2f-c7d5547b0dca None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:57.958338 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4486228-9c81-4e2b-bd2f-c7d5547b0dca None admin] PATH_INFO: `/v3/groups` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:57.958961 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4486228-9c81-4e2b-bd2f-c7d5547b0dca None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:57.960414 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4486228-9c81-4e2b-bd2f-c7d5547b0dca None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:57.966038 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:58.032363 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aa651e-2b22-4c36-b95c-b77c1493c3de None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:58.044185 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 167/326] 10.222.0.23 () {60 vars in 1134 bytes} [Thu Aug 18 19:27:57 2022] POST /identity/v3/groups => generated 226 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 19:27:58.077144 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d1d7fd-e678-4805-96c0-4cd011d6e857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:58.077901 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d1d7fd-e678-4805-96c0-4cd011d6e857 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:58.078183 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d1d7fd-e678-4805-96c0-4cd011d6e857 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:58.078452 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d1d7fd-e678-4805-96c0-4cd011d6e857 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:58.091412 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d1d7fd-e678-4805-96c0-4cd011d6e857 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:27:58.096819 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application [None req-35d1d7fd-e678-4805-96c0-4cd011d6e857 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 19:27:58.096819 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:27:58.096819 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:27:58.096819 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:27:58.096819 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:27:58.096819 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:27:58.096819 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:27:58.096819 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:27:58.096819 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:27:58.096819 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:27:58.096819 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:27:58.096819 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:27:58.096819 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:27:58.096819 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:27:58.096819 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:27:58.096819 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:27:58.098761 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:27:58.098761 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:27:58.098761 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:27:58.098761 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:27:58.098761 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:27:58.098761 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:27:58.098761 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:27:58.098761 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:27:58.098761 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:27:58.098761 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:27:58.098761 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:27:58.098761 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application with Lock( Aug 18 19:27:58.098761 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:27:58.098761 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:27:58.098761 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:27:58.098761 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:27:58.099525 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:27:58.099525 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:27:58.099525 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:27:58.099525 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:27:58.099525 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:27:58.099525 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:27:58.099525 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:27:58.099525 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:27:58.099525 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:27:58.099525 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:27:58.099525 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 19:27:58.099525 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:27:58.099525 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 160/327] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Aug 18 19:27:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:27:58.104117 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4486228-9c81-4e2b-bd2f-c7d5547b0dca None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:58.214406 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4486228-9c81-4e2b-bd2f-c7d5547b0dca None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:58.251865 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c2544-fe97-4bbd-97b2-fbb6645f518b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:58.252488 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c2544-fe97-4bbd-97b2-fbb6645f518b None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:58.252752 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c2544-fe97-4bbd-97b2-fbb6645f518b None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:58.253110 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c2544-fe97-4bbd-97b2-fbb6645f518b None admin] PATH_INFO: `/v3/roles` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:58.253865 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328c2544-fe97-4bbd-97b2-fbb6645f518b None admin] RBAC: Adding query filter params (name=reader) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:27:58.254209 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328c2544-fe97-4bbd-97b2-fbb6645f518b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:58.254477 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d1d7fd-e678-4805-96c0-4cd011d6e857 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:58.255579 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328c2544-fe97-4bbd-97b2-fbb6645f518b None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:58.264323 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 168/328] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Aug 18 19:27:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:27:58.271766 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c2544-fe97-4bbd-97b2-fbb6645f518b None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:58.313300 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:58.345889 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:58.387285 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d1d7fd-e678-4805-96c0-4cd011d6e857 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:58.401237 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c2544-fe97-4bbd-97b2-fbb6645f518b None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:58.427039 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6e2e7d-aaaf-4e29-98d1-cbb4402f8586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:58.427676 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6e2e7d-aaaf-4e29-98d1-cbb4402f8586 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:58.427953 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6e2e7d-aaaf-4e29-98d1-cbb4402f8586 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:58.428222 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6e2e7d-aaaf-4e29-98d1-cbb4402f8586 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:58.438885 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec6fe0-5fc8-4443-b4df-99270a2359c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:58.439653 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec6fe0-5fc8-4443-b4df-99270a2359c7 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:58.439785 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec6fe0-5fc8-4443-b4df-99270a2359c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:58.440036 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec6fe0-5fc8-4443-b4df-99270a2359c7 None admin] PATH_INFO: `/v3/users/f1e6874c4886424789879eecdb6c7e16` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:58.442123 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ec6fe0-5fc8-4443-b4df-99270a2359c7 None admin] RBAC: Authorizing `identity:get_user(user_id=f1e6874c4886424789879eecdb6c7e16)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:58.442905 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6e2e7d-aaaf-4e29-98d1-cbb4402f8586 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:27:58.443564 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ec6fe0-5fc8-4443-b4df-99270a2359c7 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:58.445319 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 169/329] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Aug 18 19:27:58 2022] GET /identity/v3/users/f1e6874c4886424789879eecdb6c7e16 => generated 293 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:27:58.448140 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application [None req-7f6e2e7d-aaaf-4e29-98d1-cbb4402f8586 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 19:27:58.448140 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:27:58.448140 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:27:58.448140 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:27:58.448140 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:27:58.448140 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:27:58.448140 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:27:58.448140 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:27:58.448140 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:27:58.448140 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:27:58.448140 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:27:58.448140 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:27:58.448140 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:27:58.448140 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:27:58.448140 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:27:58.448140 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:27:58.449016 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:27:58.449016 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:27:58.449016 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:27:58.449016 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:27:58.449016 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:27:58.449016 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:27:58.449016 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:27:58.449016 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:27:58.449016 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:27:58.449016 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:27:58.449016 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:27:58.449016 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application with Lock( Aug 18 19:27:58.449016 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:27:58.449016 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:27:58.449016 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:27:58.449016 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:27:58.449840 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:27:58.449840 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:27:58.449840 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:27:58.449840 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:27:58.449840 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:27:58.449840 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:27:58.449840 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:27:58.449840 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:27:58.449840 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:27:58.449840 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:27:58.449840 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 19:27:58.449840 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:27:58.449840 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 161/330] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Aug 18 19:27:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 19:27:58.451626 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec6fe0-5fc8-4443-b4df-99270a2359c7 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:58.455628 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6e2e7d-aaaf-4e29-98d1-cbb4402f8586 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:58.584267 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec6fe0-5fc8-4443-b4df-99270a2359c7 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:58.598494 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6e2e7d-aaaf-4e29-98d1-cbb4402f8586 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:58.601310 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:58.629257 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:27:58.648414 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cba1be4-437e-4236-87dd-202e1f5b60b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:58.649531 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cba1be4-437e-4236-87dd-202e1f5b60b2 None admin] REQUEST_METHOD: `PUT` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:58.650292 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cba1be4-437e-4236-87dd-202e1f5b60b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:58.650565 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cba1be4-437e-4236-87dd-202e1f5b60b2 None admin] PATH_INFO: `/v3/system/users/f1e6874c4886424789879eecdb6c7e16/roles/9aa2d4ac6d7540c68a34e8ffba0e545d` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:58.652256 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cba1be4-437e-4236-87dd-202e1f5b60b2 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=f1e6874c4886424789879eecdb6c7e16, role_id=9aa2d4ac6d7540c68a34e8ffba0e545d)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:58.653627 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cba1be4-437e-4236-87dd-202e1f5b60b2 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:58.656284 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d8bcbb-bf0d-4564-945b-f4a7dfd0808e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:58.656926 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d8bcbb-bf0d-4564-945b-f4a7dfd0808e None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:58.657199 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d8bcbb-bf0d-4564-945b-f4a7dfd0808e None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:58.657466 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d8bcbb-bf0d-4564-945b-f4a7dfd0808e None admin] PATH_INFO: `/v3/roles` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:58.658168 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d8bcbb-bf0d-4564-945b-f4a7dfd0808e None admin] RBAC: Adding query filter params (name=member) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:27:58.658466 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d8bcbb-bf0d-4564-945b-f4a7dfd0808e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:58.659861 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d8bcbb-bf0d-4564-945b-f4a7dfd0808e None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:58.670952 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 162/331] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Aug 18 19:27:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:27:58.680266 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d8bcbb-bf0d-4564-945b-f4a7dfd0808e None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:58.737125 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 170/332] 10.222.0.23 () {58 vars in 1334 bytes} [Thu Aug 18 19:27:58 2022] PUT /identity/v3/system/users/f1e6874c4886424789879eecdb6c7e16/roles/9aa2d4ac6d7540c68a34e8ffba0e545d => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 19:27:58.797595 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d8bcbb-bf0d-4564-945b-f4a7dfd0808e None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:58.838506 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca157eb2-825a-4d51-a5f9-c3d7166d3738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:58.839375 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca157eb2-825a-4d51-a5f9-c3d7166d3738 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:58.839810 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca157eb2-825a-4d51-a5f9-c3d7166d3738 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:58.840220 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca157eb2-825a-4d51-a5f9-c3d7166d3738 None admin] PATH_INFO: `/v3/users/0f55906cd00148b99cfe367083175528` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:58.841562 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca157eb2-825a-4d51-a5f9-c3d7166d3738 None admin] RBAC: Authorizing `identity:get_user(user_id=0f55906cd00148b99cfe367083175528)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:58.843255 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca157eb2-825a-4d51-a5f9-c3d7166d3738 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:58.845414 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 163/333] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Aug 18 19:27:58 2022] GET /identity/v3/users/0f55906cd00148b99cfe367083175528 => generated 293 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:27:58.853248 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cba1be4-437e-4236-87dd-202e1f5b60b2 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:27:58.973184 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cba1be4-437e-4236-87dd-202e1f5b60b2 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:27:59.009904 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3477cc-2425-4208-9bbc-a0d83e61dc6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:27:59.010751 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3477cc-2425-4208-9bbc-a0d83e61dc6b None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:27:59.011260 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3477cc-2425-4208-9bbc-a0d83e61dc6b None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:27:59.011665 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3477cc-2425-4208-9bbc-a0d83e61dc6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:27:59.012517 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3477cc-2425-4208-9bbc-a0d83e61dc6b None admin] RBAC: Adding query filter params (role.id=ece5eb2bd1334192b3eee1b7b05c042c, user.id=0f55906cd00148b99cfe367083175528, scope.system=all) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:27:59.012959 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3477cc-2425-4208-9bbc-a0d83e61dc6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:27:59.014605 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3477cc-2425-4208-9bbc-a0d83e61dc6b None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:27:59.027216 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 171/334] 10.222.0.23 () {56 vars in 1308 bytes} [Thu Aug 18 19:27:58 2022] GET /identity/v3/role_assignments?user.id=0f55906cd00148b99cfe367083175528&scope.system=all&role.id=ece5eb2bd1334192b3eee1b7b05c042c => generated 510 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:00.597643 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5e232f-3db8-4b38-95a0-60caba1a781d None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:00.598189 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5e232f-3db8-4b38-95a0-60caba1a781d None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:00.598379 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5e232f-3db8-4b38-95a0-60caba1a781d None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:00.599985 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 164/335] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:28:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:28:00.605088 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e291ecd-719b-4b6f-bccd-376db8a8e128 None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:00.605504 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e291ecd-719b-4b6f-bccd-376db8a8e128 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:00.605647 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e291ecd-719b-4b6f-bccd-376db8a8e128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:00.629113 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-3e291ecd-719b-4b6f-bccd-376db8a8e128 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:28:00.630461 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-3e291ecd-719b-4b6f-bccd-376db8a8e128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:28:00.681573 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:00.707232 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 172/336] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:28:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:28:01.194782 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef6be8-b0e4-4dfe-b6fe-62851edb136d None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:01.195164 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef6be8-b0e4-4dfe-b6fe-62851edb136d None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:01.195348 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef6be8-b0e4-4dfe-b6fe-62851edb136d None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:01.197081 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 165/337] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:28:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:28:01.203054 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaf7fa8-30b3-43a8-be29-67198d0a35fa None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:01.203419 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaf7fa8-30b3-43a8-be29-67198d0a35fa None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:01.203707 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaf7fa8-30b3-43a8-be29-67198d0a35fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:01.230811 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-dbaf7fa8-30b3-43a8-be29-67198d0a35fa None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:28:01.232032 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-dbaf7fa8-30b3-43a8-be29-67198d0a35fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:28:01.304219 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ef6be8-b0e4-4dfe-b6fe-62851edb136d None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:01.312220 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 173/338] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:28:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:28:01.358468 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:01.438678 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ef6be8-b0e4-4dfe-b6fe-62851edb136d None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:01.476075 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73d81c6-e8fa-4a22-bb4f-9c2f5c4be16d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:01.476707 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73d81c6-e8fa-4a22-bb4f-9c2f5c4be16d None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:01.476979 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73d81c6-e8fa-4a22-bb4f-9c2f5c4be16d None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:01.477247 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73d81c6-e8fa-4a22-bb4f-9c2f5c4be16d None admin] PATH_INFO: `/v3/roles/member` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:01.491018 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73d81c6-e8fa-4a22-bb4f-9c2f5c4be16d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:28:01.496209 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application [None req-b73d81c6-e8fa-4a22-bb4f-9c2f5c4be16d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 19:28:01.496209 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:01.496209 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:01.496209 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:01.496209 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:01.496209 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:01.496209 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:01.496209 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:01.496209 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:01.496209 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:01.496209 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:01.496209 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:01.496209 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:28:01.496209 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:28:01.496209 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:28:01.496209 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:28:01.497118 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:28:01.497118 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:28:01.497118 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:28:01.497118 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:28:01.497118 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:01.497118 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:01.497118 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:01.497118 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:01.497118 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:01.497118 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:01.497118 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:01.497118 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:01.497118 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:01.497118 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:01.497118 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:01.497118 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:01.497979 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:01.497979 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:01.497979 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:01.497979 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:01.497979 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:28:01.497979 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:28:01.497979 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:28:01.497979 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:28:01.497979 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:28:01.497979 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:28:01.497979 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 19:28:01.497979 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:28:01.498619 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 166/339] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Aug 18 19:28:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:28:01.506113 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaf7fa8-30b3-43a8-be29-67198d0a35fa None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:01.622733 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaf7fa8-30b3-43a8-be29-67198d0a35fa None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:01.632728 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:01.659206 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9b4617-9954-4332-bdca-a9ca35162075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:01.659903 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b4617-9954-4332-bdca-a9ca35162075 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:01.660182 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b4617-9954-4332-bdca-a9ca35162075 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:01.660515 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b4617-9954-4332-bdca-a9ca35162075 None admin] PATH_INFO: `/v3/roles` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:01.661208 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9b4617-9954-4332-bdca-a9ca35162075 None admin] RBAC: Adding query filter params (name=member) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:01.661510 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9b4617-9954-4332-bdca-a9ca35162075 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:01.662965 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9b4617-9954-4332-bdca-a9ca35162075 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:01.677058 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 174/340] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Aug 18 19:28:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:28:01.682928 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73d81c6-e8fa-4a22-bb4f-9c2f5c4be16d None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:01.817127 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:01.825924 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73d81c6-e8fa-4a22-bb4f-9c2f5c4be16d None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:01.867512 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce70db9e-c435-42d6-8fbd-289a871f586c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:01.868133 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70db9e-c435-42d6-8fbd-289a871f586c None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:01.868418 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70db9e-c435-42d6-8fbd-289a871f586c None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:01.868694 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70db9e-c435-42d6-8fbd-289a871f586c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:01.869117 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dae73f-023f-44fb-9658-e56e2425b5f0 None None] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:01.869402 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dae73f-023f-44fb-9658-e56e2425b5f0 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:01.869690 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dae73f-023f-44fb-9658-e56e2425b5f0 None None] PATH_INFO: `/` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:01.871334 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 175/341] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:28:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:28:01.881875 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0896e-f3cb-4322-a796-ffb5afc194a4 None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:01.882128 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0896e-f3cb-4322-a796-ffb5afc194a4 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:01.882349 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0896e-f3cb-4322-a796-ffb5afc194a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:01.915953 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-83f0896e-f3cb-4322-a796-ffb5afc194a4 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:28:01.917145 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-83f0896e-f3cb-4322-a796-ffb5afc194a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:28:02.009223 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce70db9e-c435-42d6-8fbd-289a871f586c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:02.012902 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce70db9e-c435-42d6-8fbd-289a871f586c None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:02.050375 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 176/342] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:28:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:28:02.051476 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f0896e-f3cb-4322-a796-ffb5afc194a4 None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:02.173034 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:02.189765 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 167/343] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Aug 18 19:28:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 19:28:02.193365 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce70db9e-c435-42d6-8fbd-289a871f586c None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:02.214419 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:02.218163 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f0896e-f3cb-4322-a796-ffb5afc194a4 None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:02.265418 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4894ff-daa6-448c-bc21-c1d8ef74b4c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:02.266893 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4894ff-daa6-448c-bc21-c1d8ef74b4c4 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:02.267332 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4894ff-daa6-448c-bc21-c1d8ef74b4c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:02.267756 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4894ff-daa6-448c-bc21-c1d8ef74b4c4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:02.279608 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4894ff-daa6-448c-bc21-c1d8ef74b4c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:28:02.285979 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application [None req-ea4894ff-daa6-448c-bc21-c1d8ef74b4c4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 19:28:02.285979 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:02.285979 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:02.285979 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:02.285979 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:02.285979 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:02.285979 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:02.285979 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:02.285979 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:02.285979 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:02.285979 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:02.285979 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:02.285979 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:28:02.285979 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:28:02.285979 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:28:02.285979 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:28:02.286957 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:28:02.286957 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:28:02.286957 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:28:02.286957 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:28:02.286957 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:02.286957 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:02.286957 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:02.286957 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:02.286957 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:02.286957 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:02.286957 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:02.286957 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:02.286957 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:02.286957 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:02.286957 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:02.286957 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:02.287737 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:02.287737 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:02.287737 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:02.287737 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:02.287737 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:28:02.287737 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:28:02.287737 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:28:02.287737 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:28:02.287737 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:28:02.287737 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:28:02.287737 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 19:28:02.287737 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:28:02.292775 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 177/344] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Aug 18 19:28:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:28:02.300016 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8acc20-1645-4496-bf31-9a865eccf70b None None] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:02.300016 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8acc20-1645-4496-bf31-9a865eccf70b None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:02.300016 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8acc20-1645-4496-bf31-9a865eccf70b None None] PATH_INFO: `/` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:02.300016 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 178/345] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:28:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:28:02.301943 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c8d626-9a81-4b95-b9cb-66d95e8585e4 None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:02.302415 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c8d626-9a81-4b95-b9cb-66d95e8585e4 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:02.302867 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c8d626-9a81-4b95-b9cb-66d95e8585e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:02.311265 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce70db9e-c435-42d6-8fbd-289a871f586c None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:02.326933 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-17c8d626-9a81-4b95-b9cb-66d95e8585e4 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:28:02.329105 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-17c8d626-9a81-4b95-b9cb-66d95e8585e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:28:02.350574 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eef4eaa-fe52-445c-9903-113b9693e537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:02.351334 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eef4eaa-fe52-445c-9903-113b9693e537 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:02.351466 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eef4eaa-fe52-445c-9903-113b9693e537 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:02.351739 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eef4eaa-fe52-445c-9903-113b9693e537 None admin] PATH_INFO: `/v3/projects/84c3b97bc50848039730cfaab66f74f9` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:02.352874 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eef4eaa-fe52-445c-9903-113b9693e537 None admin] RBAC: Authorizing `identity:get_project(project_id=84c3b97bc50848039730cfaab66f74f9)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:02.354353 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eef4eaa-fe52-445c-9903-113b9693e537 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:02.356349 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 168/346] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Aug 18 19:28:02 2022] GET /identity/v3/projects/84c3b97bc50848039730cfaab66f74f9 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:28:02.357260 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eef4eaa-fe52-445c-9903-113b9693e537 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:02.412054 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 179/347] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:28:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:28:02.413301 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c8d626-9a81-4b95-b9cb-66d95e8585e4 None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:02.419689 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:02.461992 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eef4eaa-fe52-445c-9903-113b9693e537 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:02.499415 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8219a7d-d23b-4cd2-8d4f-ac4aca58329d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:02.499711 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8219a7d-d23b-4cd2-8d4f-ac4aca58329d None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:02.500521 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8219a7d-d23b-4cd2-8d4f-ac4aca58329d None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:02.500796 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8219a7d-d23b-4cd2-8d4f-ac4aca58329d None admin] PATH_INFO: `/v3/roles` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:02.501497 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8219a7d-d23b-4cd2-8d4f-ac4aca58329d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:02.501833 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8219a7d-d23b-4cd2-8d4f-ac4aca58329d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:02.503372 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8219a7d-d23b-4cd2-8d4f-ac4aca58329d None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:02.511560 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 169/348] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Aug 18 19:28:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:02.517919 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8219a7d-d23b-4cd2-8d4f-ac4aca58329d None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:02.519547 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:02.530468 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c8d626-9a81-4b95-b9cb-66d95e8585e4 None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:02.568652 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf99fb21-8a05-4bd9-ac0f-d5a6f3887a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:02.569733 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf99fb21-8a05-4bd9-ac0f-d5a6f3887a4e None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:02.570318 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf99fb21-8a05-4bd9-ac0f-d5a6f3887a4e None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:02.570783 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf99fb21-8a05-4bd9-ac0f-d5a6f3887a4e None admin] PATH_INFO: `/v3/groups/70f4cdfc68f04bca8b5b215dc175403c` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:02.577588 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf99fb21-8a05-4bd9-ac0f-d5a6f3887a4e None admin] RBAC: Authorizing `identity:get_group(group_id=70f4cdfc68f04bca8b5b215dc175403c)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:02.580022 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf99fb21-8a05-4bd9-ac0f-d5a6f3887a4e None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:02.582441 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 180/349] 10.222.0.23 () {56 vars in 1180 bytes} [Thu Aug 18 19:28:02 2022] GET /identity/v3/groups/70f4cdfc68f04bca8b5b215dc175403c => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:02.590778 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf99fb21-8a05-4bd9-ac0f-d5a6f3887a4e None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:02.625793 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8219a7d-d23b-4cd2-8d4f-ac4aca58329d None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:02.654184 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:02.662658 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402c468b-ae98-4f62-8af9-fc5c1a2f583c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:02.670824 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c468b-ae98-4f62-8af9-fc5c1a2f583c None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:02.670824 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c468b-ae98-4f62-8af9-fc5c1a2f583c None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:02.670824 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c468b-ae98-4f62-8af9-fc5c1a2f583c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:02.738003 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf99fb21-8a05-4bd9-ac0f-d5a6f3887a4e None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:02.767187 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402c468b-ae98-4f62-8af9-fc5c1a2f583c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:02.768642 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402c468b-ae98-4f62-8af9-fc5c1a2f583c None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:02.777159 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1151e7a-02ad-46fc-819a-8f72adf8fa86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:02.778082 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1151e7a-02ad-46fc-819a-8f72adf8fa86 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:02.778665 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1151e7a-02ad-46fc-819a-8f72adf8fa86 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:02.779127 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1151e7a-02ad-46fc-819a-8f72adf8fa86 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:02.780095 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1151e7a-02ad-46fc-819a-8f72adf8fa86 None admin] RBAC: Adding query filter params (group.id=70f4cdfc68f04bca8b5b215dc175403c, role.id=ece5eb2bd1334192b3eee1b7b05c042c, scope.project.id=84c3b97bc50848039730cfaab66f74f9) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:02.780604 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1151e7a-02ad-46fc-819a-8f72adf8fa86 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:02.782347 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1151e7a-02ad-46fc-819a-8f72adf8fa86 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:02.788641 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 181/350] 10.222.0.23 () {56 vars in 1376 bytes} [Thu Aug 18 19:28:02 2022] GET /identity/v3/role_assignments?group.id=70f4cdfc68f04bca8b5b215dc175403c&scope.project.id=84c3b97bc50848039730cfaab66f74f9&role.id=ece5eb2bd1334192b3eee1b7b05c042c => generated 260 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:02.789795 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1151e7a-02ad-46fc-819a-8f72adf8fa86 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:02.822121 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:02.911502 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1151e7a-02ad-46fc-819a-8f72adf8fa86 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:02.952511 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a918420-2a0c-4b5b-89e2-e4e24efd5a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:02.953573 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a918420-2a0c-4b5b-89e2-e4e24efd5a9c None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:02.954212 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a918420-2a0c-4b5b-89e2-e4e24efd5a9c None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:02.954682 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a918420-2a0c-4b5b-89e2-e4e24efd5a9c None admin] PATH_INFO: `/v3/roles/member` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:02.967660 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a918420-2a0c-4b5b-89e2-e4e24efd5a9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:28:02.973284 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application [None req-6a918420-2a0c-4b5b-89e2-e4e24efd5a9c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 19:28:02.973284 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:02.973284 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:02.973284 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:02.973284 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:02.973284 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:02.973284 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:02.973284 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:02.973284 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:02.973284 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:02.973284 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:02.973284 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:02.973284 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:28:02.973284 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:28:02.973284 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:28:02.973284 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:28:02.974285 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:28:02.974285 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:28:02.974285 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:28:02.974285 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:28:02.974285 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:02.974285 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:02.974285 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:02.974285 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:02.974285 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:02.974285 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:02.974285 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:02.974285 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:02.974285 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:02.974285 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:02.974285 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:02.974285 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:02.975122 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:02.975122 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:02.975122 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:02.975122 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:02.975122 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:28:02.975122 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:28:02.975122 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:28:02.975122 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:28:02.975122 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:28:02.975122 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:28:02.975122 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 19:28:02.975122 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:28:02.977145 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 182/351] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Aug 18 19:28:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:28:02.978171 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a918420-2a0c-4b5b-89e2-e4e24efd5a9c None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:02.994852 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 170/352] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Aug 18 19:28:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 18 19:28:02.995678 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402c468b-ae98-4f62-8af9-fc5c1a2f583c None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:03.042087 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:03.084514 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:03.110557 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a918420-2a0c-4b5b-89e2-e4e24efd5a9c None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:03.157238 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1a8530-27a1-4c22-9b50-39838453a72d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:03.158510 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a8530-27a1-4c22-9b50-39838453a72d None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:03.158926 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a8530-27a1-4c22-9b50-39838453a72d None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:03.159345 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a8530-27a1-4c22-9b50-39838453a72d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:03.171421 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1a8530-27a1-4c22-9b50-39838453a72d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:28:03.177587 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application [None req-4d1a8530-27a1-4c22-9b50-39838453a72d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 19:28:03.177587 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:03.177587 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:03.177587 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:03.177587 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:03.177587 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:03.177587 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:03.177587 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:03.177587 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:03.177587 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:03.177587 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:03.177587 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:03.177587 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:28:03.177587 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:28:03.177587 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:28:03.177587 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:28:03.178537 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:28:03.178537 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:28:03.178537 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:28:03.178537 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:28:03.178537 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:03.178537 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:03.178537 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:03.178537 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:03.178537 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:03.178537 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:03.178537 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:03.178537 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:03.178537 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:03.178537 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:03.178537 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:03.178537 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:03.179314 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:03.179314 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:03.179314 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:03.179314 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:03.179314 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:28:03.179314 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:28:03.179314 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:28:03.179314 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:28:03.179314 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:28:03.179314 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:28:03.179314 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 19:28:03.179314 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:28:03.182569 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 183/353] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Aug 18 19:28:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:28:03.183623 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1a8530-27a1-4c22-9b50-39838453a72d None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:03.207603 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402c468b-ae98-4f62-8af9-fc5c1a2f583c None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:03.266905 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86277af0-1c6f-4faf-9822-b52a94aca595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:03.267446 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86277af0-1c6f-4faf-9822-b52a94aca595 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:03.267721 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86277af0-1c6f-4faf-9822-b52a94aca595 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:03.267991 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86277af0-1c6f-4faf-9822-b52a94aca595 None admin] PATH_INFO: `/v3/roles` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:03.268649 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86277af0-1c6f-4faf-9822-b52a94aca595 None admin] RBAC: Adding query filter params (name=member) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:03.268946 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86277af0-1c6f-4faf-9822-b52a94aca595 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:03.270356 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86277af0-1c6f-4faf-9822-b52a94aca595 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:03.279221 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 171/354] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Aug 18 19:28:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:03.280050 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86277af0-1c6f-4faf-9822-b52a94aca595 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:03.326993 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1a8530-27a1-4c22-9b50-39838453a72d None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:03.373024 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238cc48a-6ea9-42f4-b997-67329ce5baae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:03.373690 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238cc48a-6ea9-42f4-b997-67329ce5baae None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:03.374063 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238cc48a-6ea9-42f4-b997-67329ce5baae None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:03.374309 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238cc48a-6ea9-42f4-b997-67329ce5baae None admin] PATH_INFO: `/v3/projects/84c3b97bc50848039730cfaab66f74f9` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:03.375485 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238cc48a-6ea9-42f4-b997-67329ce5baae None admin] RBAC: Authorizing `identity:get_project(project_id=84c3b97bc50848039730cfaab66f74f9)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:03.377262 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238cc48a-6ea9-42f4-b997-67329ce5baae None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:03.379269 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 184/355] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Aug 18 19:28:03 2022] GET /identity/v3/projects/84c3b97bc50848039730cfaab66f74f9 => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:03.380504 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecfeafb-3f6b-4a88-84d8-cf71bcd663e6 None None] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:03.380792 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecfeafb-3f6b-4a88-84d8-cf71bcd663e6 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:03.381067 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecfeafb-3f6b-4a88-84d8-cf71bcd663e6 None None] PATH_INFO: `/` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:03.382535 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 185/356] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:28:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:28:03.383418 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecfeafb-3f6b-4a88-84d8-cf71bcd663e6 None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:03.398949 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:03.401979 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:03.427582 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86277af0-1c6f-4faf-9822-b52a94aca595 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:03.479279 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dce447-75b1-4c51-a9ee-a4fe7f7145b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:03.479952 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dce447-75b1-4c51-a9ee-a4fe7f7145b4 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:03.480297 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dce447-75b1-4c51-a9ee-a4fe7f7145b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:03.480582 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dce447-75b1-4c51-a9ee-a4fe7f7145b4 None admin] PATH_INFO: `/v3/roles` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:03.481305 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dce447-75b1-4c51-a9ee-a4fe7f7145b4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:03.485173 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dce447-75b1-4c51-a9ee-a4fe7f7145b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:03.487496 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dce447-75b1-4c51-a9ee-a4fe7f7145b4 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:03.498061 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 172/357] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Aug 18 19:28:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:03.503752 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dce447-75b1-4c51-a9ee-a4fe7f7145b4 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:03.523916 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecfeafb-3f6b-4a88-84d8-cf71bcd663e6 None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:03.569307 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb10480-a126-45c6-9cfe-e6c7012a36bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:03.569826 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb10480-a126-45c6-9cfe-e6c7012a36bf None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:03.570144 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb10480-a126-45c6-9cfe-e6c7012a36bf None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:03.570492 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb10480-a126-45c6-9cfe-e6c7012a36bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:03.644678 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dce447-75b1-4c51-a9ee-a4fe7f7145b4 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:03.677375 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb10480-a126-45c6-9cfe-e6c7012a36bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:03.678959 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb10480-a126-45c6-9cfe-e6c7012a36bf None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:03.681613 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788101ad-d171-4ed0-a1f4-d56d4aff6c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:03.682550 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788101ad-d171-4ed0-a1f4-d56d4aff6c37 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:03.683048 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788101ad-d171-4ed0-a1f4-d56d4aff6c37 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:03.683517 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788101ad-d171-4ed0-a1f4-d56d4aff6c37 None admin] PATH_INFO: `/v3/groups/70f4cdfc68f04bca8b5b215dc175403c` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:03.684836 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788101ad-d171-4ed0-a1f4-d56d4aff6c37 None admin] RBAC: Authorizing `identity:get_group(group_id=70f4cdfc68f04bca8b5b215dc175403c)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:03.686512 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788101ad-d171-4ed0-a1f4-d56d4aff6c37 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:03.687349 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:03.688753 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 173/358] 10.222.0.23 () {56 vars in 1180 bytes} [Thu Aug 18 19:28:03 2022] GET /identity/v3/groups/70f4cdfc68f04bca8b5b215dc175403c => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:03.692371 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e9a4f0-ca58-4f86-9a0f-e5afffc97bca None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:03.692817 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e9a4f0-ca58-4f86-9a0f-e5afffc97bca None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:03.693195 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e9a4f0-ca58-4f86-9a0f-e5afffc97bca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:03.711855 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-c5e9a4f0-ca58-4f86-9a0f-e5afffc97bca None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:28:03.713462 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-c5e9a4f0-ca58-4f86-9a0f-e5afffc97bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:28:03.724071 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:03.787168 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 174/359] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:28:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:28:03.793740 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e9a4f0-ca58-4f86-9a0f-e5afffc97bca None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:03.804879 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 186/360] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Aug 18 19:28:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 19:28:03.806308 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb10480-a126-45c6-9cfe-e6c7012a36bf None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:03.930988 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e9a4f0-ca58-4f86-9a0f-e5afffc97bca None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:03.942963 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb10480-a126-45c6-9cfe-e6c7012a36bf None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:03.957976 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:03.976530 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00e82bb-ee34-44a1-9eb0-6f79cd13240d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:03.977438 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e82bb-ee34-44a1-9eb0-6f79cd13240d None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:03.977744 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e82bb-ee34-44a1-9eb0-6f79cd13240d None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:03.978022 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e82bb-ee34-44a1-9eb0-6f79cd13240d None admin] PATH_INFO: `/v3/users/f1e6874c4886424789879eecdb6c7e16` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:03.982388 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00e82bb-ee34-44a1-9eb0-6f79cd13240d None admin] RBAC: Authorizing `identity:get_user(user_id=f1e6874c4886424789879eecdb6c7e16)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:03.983958 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00e82bb-ee34-44a1-9eb0-6f79cd13240d None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:03.986616 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 175/361] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Aug 18 19:28:03 2022] GET /identity/v3/users/f1e6874c4886424789879eecdb6c7e16 => generated 293 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:03.987765 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee26665-32e8-4c47-8b84-6dd1879cf6f6 None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:03.988153 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee26665-32e8-4c47-8b84-6dd1879cf6f6 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:03.988548 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee26665-32e8-4c47-8b84-6dd1879cf6f6 None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:03.989910 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 176/362] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:28:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:28:03.993708 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee26665-32e8-4c47-8b84-6dd1879cf6f6 None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:03.999008 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062f5df1-afca-4a9f-a651-d7dda64d30ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:04.000430 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062f5df1-afca-4a9f-a651-d7dda64d30ad None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:04.000893 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062f5df1-afca-4a9f-a651-d7dda64d30ad None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:04.001319 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062f5df1-afca-4a9f-a651-d7dda64d30ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:04.002795 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062f5df1-afca-4a9f-a651-d7dda64d30ad None admin] RBAC: Adding query filter params (group.id=70f4cdfc68f04bca8b5b215dc175403c, role.id=629bead347a8449ebece758b5a7ae23d, scope.project.id=84c3b97bc50848039730cfaab66f74f9) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:04.003258 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062f5df1-afca-4a9f-a651-d7dda64d30ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:04.004846 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062f5df1-afca-4a9f-a651-d7dda64d30ad None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:04.009376 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:04.011466 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 187/363] 10.222.0.23 () {56 vars in 1376 bytes} [Thu Aug 18 19:28:03 2022] GET /identity/v3/role_assignments?group.id=70f4cdfc68f04bca8b5b215dc175403c&scope.project.id=84c3b97bc50848039730cfaab66f74f9&role.id=629bead347a8449ebece758b5a7ae23d => generated 260 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:04.020308 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062f5df1-afca-4a9f-a651-d7dda64d30ad None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:04.195357 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee26665-32e8-4c47-8b84-6dd1879cf6f6 None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:04.242660 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062f5df1-afca-4a9f-a651-d7dda64d30ad None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:04.243970 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201064e9-fbf6-4706-bc32-055bc875440f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:04.244924 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201064e9-fbf6-4706-bc32-055bc875440f None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:04.245212 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201064e9-fbf6-4706-bc32-055bc875440f None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:04.245487 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201064e9-fbf6-4706-bc32-055bc875440f None admin] PATH_INFO: `/v3/projects/f04621419eb84b00a435d700f145cf48` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:04.248003 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201064e9-fbf6-4706-bc32-055bc875440f None admin] RBAC: Authorizing `identity:get_project(project_id=f04621419eb84b00a435d700f145cf48)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:04.249304 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201064e9-fbf6-4706-bc32-055bc875440f None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:04.252017 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 177/364] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Aug 18 19:28:03 2022] GET /identity/v3/projects/f04621419eb84b00a435d700f145cf48 => generated 302 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:04.253395 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2b1589-c5cc-4ae3-a0da-f890507a528b None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:04.253707 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2b1589-c5cc-4ae3-a0da-f890507a528b None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:04.253987 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2b1589-c5cc-4ae3-a0da-f890507a528b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:04.281351 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-be2b1589-c5cc-4ae3-a0da-f890507a528b None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:28:04.283383 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-be2b1589-c5cc-4ae3-a0da-f890507a528b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:28:04.297543 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93959e8f-7346-4d7f-a3da-b17e58d28dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:04.298635 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93959e8f-7346-4d7f-a3da-b17e58d28dae None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:04.299119 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93959e8f-7346-4d7f-a3da-b17e58d28dae None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:04.299633 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93959e8f-7346-4d7f-a3da-b17e58d28dae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:04.300585 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93959e8f-7346-4d7f-a3da-b17e58d28dae None admin] RBAC: Adding query filter params (role.id=9aa2d4ac6d7540c68a34e8ffba0e545d, user.id=f1e6874c4886424789879eecdb6c7e16, scope.system=all) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:04.301109 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93959e8f-7346-4d7f-a3da-b17e58d28dae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:04.302837 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93959e8f-7346-4d7f-a3da-b17e58d28dae None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:04.320053 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 188/365] 10.222.0.23 () {56 vars in 1308 bytes} [Thu Aug 18 19:28:04 2022] GET /identity/v3/role_assignments?user.id=f1e6874c4886424789879eecdb6c7e16&scope.system=all&role.id=9aa2d4ac6d7540c68a34e8ffba0e545d => generated 510 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:04.321972 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93959e8f-7346-4d7f-a3da-b17e58d28dae None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:04.358566 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:04.376670 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 178/366] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:28:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:28:04.377919 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2b1589-c5cc-4ae3-a0da-f890507a528b None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:04.393724 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:04.511030 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2b1589-c5cc-4ae3-a0da-f890507a528b None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:04.534084 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93959e8f-7346-4d7f-a3da-b17e58d28dae None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:04.597608 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3561e9d-6bb4-4d1b-9a07-c8d84a8b9179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:04.598530 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3561e9d-6bb4-4d1b-9a07-c8d84a8b9179 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:04.598965 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3561e9d-6bb4-4d1b-9a07-c8d84a8b9179 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:04.599392 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3561e9d-6bb4-4d1b-9a07-c8d84a8b9179 None admin] PATH_INFO: `/v3/groups/70f4cdfc68f04bca8b5b215dc175403c` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:04.600689 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3561e9d-6bb4-4d1b-9a07-c8d84a8b9179 None admin] RBAC: Authorizing `identity:get_group(group_id=70f4cdfc68f04bca8b5b215dc175403c)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:04.602358 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3561e9d-6bb4-4d1b-9a07-c8d84a8b9179 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:04.604311 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 179/367] 10.222.0.23 () {56 vars in 1180 bytes} [Thu Aug 18 19:28:04 2022] GET /identity/v3/groups/70f4cdfc68f04bca8b5b215dc175403c => generated 226 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:04.611657 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3561e9d-6bb4-4d1b-9a07-c8d84a8b9179 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:04.615336 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deaf7b9-26db-4b1c-bacd-b727366bc830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:04.617129 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deaf7b9-26db-4b1c-bacd-b727366bc830 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:04.617416 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deaf7b9-26db-4b1c-bacd-b727366bc830 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:04.617747 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deaf7b9-26db-4b1c-bacd-b727366bc830 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:04.633275 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deaf7b9-26db-4b1c-bacd-b727366bc830 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:28:04.642474 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application [None req-6deaf7b9-26db-4b1c-bacd-b727366bc830 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 19:28:04.642474 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:04.642474 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:04.642474 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:04.642474 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:04.642474 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:04.642474 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:04.642474 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:04.642474 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:04.642474 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:04.642474 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:04.642474 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:04.642474 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:28:04.642474 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:28:04.642474 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:28:04.642474 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:28:04.643607 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:28:04.643607 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:28:04.643607 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:28:04.643607 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:28:04.643607 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:04.643607 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:04.643607 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:04.643607 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:04.643607 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:04.643607 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:04.643607 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:04.643607 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:04.643607 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:04.643607 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:04.643607 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:04.643607 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:04.644490 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:04.644490 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:04.644490 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:04.644490 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:04.644490 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:28:04.644490 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:28:04.644490 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:28:04.644490 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:28:04.644490 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:28:04.644490 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:28:04.644490 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 19:28:04.644490 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:28:04.644490 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 189/368] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Aug 18 19:28:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:28:04.650601 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deaf7b9-26db-4b1c-bacd-b727366bc830 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:04.716501 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:04.741899 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3561e9d-6bb4-4d1b-9a07-c8d84a8b9179 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:04.756852 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:04.770103 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deaf7b9-26db-4b1c-bacd-b727366bc830 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:04.780152 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13000873-1e86-41b8-9e1c-f7d04ed6c53f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:04.781511 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13000873-1e86-41b8-9e1c-f7d04ed6c53f None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:04.781963 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13000873-1e86-41b8-9e1c-f7d04ed6c53f None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:04.782380 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13000873-1e86-41b8-9e1c-f7d04ed6c53f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:04.783252 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13000873-1e86-41b8-9e1c-f7d04ed6c53f None admin] RBAC: Adding query filter params (group.id=70f4cdfc68f04bca8b5b215dc175403c, role.id=ece5eb2bd1334192b3eee1b7b05c042c, scope.project.id=f04621419eb84b00a435d700f145cf48) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:04.783732 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13000873-1e86-41b8-9e1c-f7d04ed6c53f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:04.785310 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13000873-1e86-41b8-9e1c-f7d04ed6c53f None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:04.791543 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 180/369] 10.222.0.23 () {56 vars in 1376 bytes} [Thu Aug 18 19:28:04 2022] GET /identity/v3/role_assignments?group.id=70f4cdfc68f04bca8b5b215dc175403c&scope.project.id=f04621419eb84b00a435d700f145cf48&role.id=ece5eb2bd1334192b3eee1b7b05c042c => generated 260 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:04.808765 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529833b5-065d-4777-b43f-b5c64547e027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:04.814000 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529833b5-065d-4777-b43f-b5c64547e027 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:04.814000 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529833b5-065d-4777-b43f-b5c64547e027 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:04.814000 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529833b5-065d-4777-b43f-b5c64547e027 None admin] PATH_INFO: `/v3/roles` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:04.814000 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529833b5-065d-4777-b43f-b5c64547e027 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:04.814000 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529833b5-065d-4777-b43f-b5c64547e027 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:04.814000 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529833b5-065d-4777-b43f-b5c64547e027 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:04.822538 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 190/370] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Aug 18 19:28:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:04.828272 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13000873-1e86-41b8-9e1c-f7d04ed6c53f None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:04.865879 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529833b5-065d-4777-b43f-b5c64547e027 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:04.954942 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13000873-1e86-41b8-9e1c-f7d04ed6c53f None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:04.996996 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9239be6e-7e3f-4d45-95e7-f2c3de48ab40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:04.998172 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9239be6e-7e3f-4d45-95e7-f2c3de48ab40 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:04.998654 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9239be6e-7e3f-4d45-95e7-f2c3de48ab40 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:04.999115 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9239be6e-7e3f-4d45-95e7-f2c3de48ab40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:05.013938 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:05.034468 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529833b5-065d-4777-b43f-b5c64547e027 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:05.079652 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9239be6e-7e3f-4d45-95e7-f2c3de48ab40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:05.081601 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9239be6e-7e3f-4d45-95e7-f2c3de48ab40 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:05.106501 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54521689-6dcd-4f23-8817-70b11506be37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:05.107148 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54521689-6dcd-4f23-8817-70b11506be37 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:05.107430 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54521689-6dcd-4f23-8817-70b11506be37 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:05.107707 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54521689-6dcd-4f23-8817-70b11506be37 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:05.129987 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54521689-6dcd-4f23-8817-70b11506be37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:28:05.135577 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application [None req-54521689-6dcd-4f23-8817-70b11506be37 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 19:28:05.135577 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:05.135577 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:05.135577 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:05.135577 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:05.135577 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:05.135577 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:05.135577 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:05.135577 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:05.135577 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:05.135577 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:05.135577 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:05.135577 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:28:05.135577 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:28:05.135577 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:28:05.135577 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:28:05.136471 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:28:05.136471 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:28:05.136471 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:28:05.136471 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:28:05.136471 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:05.136471 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:05.136471 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:05.136471 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:05.136471 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:05.136471 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:05.136471 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:05.136471 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:05.136471 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:05.136471 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:05.136471 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:05.136471 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:05.137859 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:05.137859 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:05.137859 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:05.137859 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:05.137859 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:28:05.137859 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:28:05.137859 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:28:05.137859 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:28:05.137859 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:28:05.137859 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:28:05.137859 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 19:28:05.137859 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:28:05.137859 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 191/371] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Aug 18 19:28:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:28:05.152720 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54521689-6dcd-4f23-8817-70b11506be37 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:05.176090 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:05.197066 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 181/372] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Aug 18 19:28:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 19:28:05.206686 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9239be6e-7e3f-4d45-95e7-f2c3de48ab40 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:05.265902 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:05.361710 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54521689-6dcd-4f23-8817-70b11506be37 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:05.377023 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9239be6e-7e3f-4d45-95e7-f2c3de48ab40 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:05.430015 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf60fd0-8220-4071-9fdb-0e4d83082adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:05.431829 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf60fd0-8220-4071-9fdb-0e4d83082adf None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:05.432315 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf60fd0-8220-4071-9fdb-0e4d83082adf None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:05.432876 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf60fd0-8220-4071-9fdb-0e4d83082adf None admin] PATH_INFO: `/v3/roles` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:05.434281 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf60fd0-8220-4071-9fdb-0e4d83082adf None admin] RBAC: Adding query filter params (name=admin) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:05.434919 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf60fd0-8220-4071-9fdb-0e4d83082adf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:05.437039 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf60fd0-8220-4071-9fdb-0e4d83082adf None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:05.443757 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bdd8fb-f632-493b-912f-633c706e425a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:05.444619 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bdd8fb-f632-493b-912f-633c706e425a None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:05.447802 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bdd8fb-f632-493b-912f-633c706e425a None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:05.448252 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bdd8fb-f632-493b-912f-633c706e425a None admin] PATH_INFO: `/v3/projects/f04621419eb84b00a435d700f145cf48` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:05.449625 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bdd8fb-f632-493b-912f-633c706e425a None admin] RBAC: Authorizing `identity:get_project(project_id=f04621419eb84b00a435d700f145cf48)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:05.451416 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bdd8fb-f632-493b-912f-633c706e425a None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:05.457748 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 182/373] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Aug 18 19:28:05 2022] GET /identity/v3/projects/f04621419eb84b00a435d700f145cf48 => generated 302 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:05.460115 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 192/374] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Aug 18 19:28:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:28:05.463836 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bdd8fb-f632-493b-912f-633c706e425a None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:05.465376 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf60fd0-8220-4071-9fdb-0e4d83082adf None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:05.598184 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:05.651838 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf60fd0-8220-4071-9fdb-0e4d83082adf None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:05.663870 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bdd8fb-f632-493b-912f-633c706e425a None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:05.685363 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:05.717110 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60ec87d-73af-45c8-9005-079552446a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:05.719446 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60ec87d-73af-45c8-9005-079552446a09 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:05.719944 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60ec87d-73af-45c8-9005-079552446a09 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:05.721207 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60ec87d-73af-45c8-9005-079552446a09 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:05.747078 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fe2c35-ab67-4bb7-929e-a7b796379fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:05.748107 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe2c35-ab67-4bb7-929e-a7b796379fd9 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:05.748593 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe2c35-ab67-4bb7-929e-a7b796379fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:05.749092 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe2c35-ab67-4bb7-929e-a7b796379fd9 None admin] PATH_INFO: `/v3/groups/70f4cdfc68f04bca8b5b215dc175403c` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:05.754113 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fe2c35-ab67-4bb7-929e-a7b796379fd9 None admin] RBAC: Authorizing `identity:get_group(group_id=70f4cdfc68f04bca8b5b215dc175403c)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:05.756011 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fe2c35-ab67-4bb7-929e-a7b796379fd9 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:05.766899 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 183/375] 10.222.0.23 () {56 vars in 1180 bytes} [Thu Aug 18 19:28:05 2022] GET /identity/v3/groups/70f4cdfc68f04bca8b5b215dc175403c => generated 226 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:28:05.783918 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fe2c35-ab67-4bb7-929e-a7b796379fd9 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:05.872130 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60ec87d-73af-45c8-9005-079552446a09 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:05.875635 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60ec87d-73af-45c8-9005-079552446a09 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:05.968263 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:05.978054 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fe2c35-ab67-4bb7-929e-a7b796379fd9 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:05.997352 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 193/376] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Aug 18 19:28:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 19:28:05.998923 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f3be04-85b5-4b79-89df-771a947be123 None None] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:05.999525 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f3be04-85b5-4b79-89df-771a947be123 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:06.000471 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f3be04-85b5-4b79-89df-771a947be123 None None] PATH_INFO: `/` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:06.003652 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 194/377] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:28:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:28:06.004477 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f3be04-85b5-4b79-89df-771a947be123 None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:06.041551 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d427b430-f5b9-44a8-a337-0da65e26ce33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:06.042222 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d427b430-f5b9-44a8-a337-0da65e26ce33 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:06.042503 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d427b430-f5b9-44a8-a337-0da65e26ce33 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:06.043060 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d427b430-f5b9-44a8-a337-0da65e26ce33 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:06.044207 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d427b430-f5b9-44a8-a337-0da65e26ce33 None admin] RBAC: Adding query filter params (group.id=70f4cdfc68f04bca8b5b215dc175403c, role.id=629bead347a8449ebece758b5a7ae23d, scope.project.id=f04621419eb84b00a435d700f145cf48) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:06.044790 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d427b430-f5b9-44a8-a337-0da65e26ce33 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:06.047762 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d427b430-f5b9-44a8-a337-0da65e26ce33 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:06.057363 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 184/378] 10.222.0.23 () {56 vars in 1376 bytes} [Thu Aug 18 19:28:05 2022] GET /identity/v3/role_assignments?group.id=70f4cdfc68f04bca8b5b215dc175403c&scope.project.id=f04621419eb84b00a435d700f145cf48&role.id=629bead347a8449ebece758b5a7ae23d => generated 260 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:28:06.058913 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e0837-8d16-49c6-9e46-499d7771fb31 None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:06.059211 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e0837-8d16-49c6-9e46-499d7771fb31 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:06.059493 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e0837-8d16-49c6-9e46-499d7771fb31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:06.099799 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-6f5e0837-8d16-49c6-9e46-499d7771fb31 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:28:06.102991 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-6f5e0837-8d16-49c6-9e46-499d7771fb31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:28:06.181585 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f3be04-85b5-4b79-89df-771a947be123 None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:06.212889 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:06.226045 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9378f2-1129-4b34-a826-9dd5accbd7e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:06.226045 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9378f2-1129-4b34-a826-9dd5accbd7e2 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:06.226045 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9378f2-1129-4b34-a826-9dd5accbd7e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:06.226045 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9378f2-1129-4b34-a826-9dd5accbd7e2 None admin] PATH_INFO: `/v3/projects/df56ebe1a05047a7a4d05174a8a4c7f1` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:06.226434 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9378f2-1129-4b34-a826-9dd5accbd7e2 None admin] RBAC: Authorizing `identity:get_project(project_id=df56ebe1a05047a7a4d05174a8a4c7f1)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:06.226716 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9378f2-1129-4b34-a826-9dd5accbd7e2 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:06.228590 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 195/379] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Aug 18 19:28:06 2022] GET /identity/v3/projects/df56ebe1a05047a7a4d05174a8a4c7f1 => generated 344 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:06.235226 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9378f2-1129-4b34-a826-9dd5accbd7e2 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:06.275264 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 185/380] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:28:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:28:06.286837 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:06.361065 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9378f2-1129-4b34-a826-9dd5accbd7e2 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:06.410906 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2963cef8-9d4b-409b-9101-2ec92544499b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:06.411556 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2963cef8-9d4b-409b-9101-2ec92544499b None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:06.411835 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2963cef8-9d4b-409b-9101-2ec92544499b None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:06.412111 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2963cef8-9d4b-409b-9101-2ec92544499b None admin] PATH_INFO: `/v3/groups/7d0df689d48744fa93e2a493f380a06a` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:06.417375 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2963cef8-9d4b-409b-9101-2ec92544499b None admin] RBAC: Authorizing `identity:get_group(group_id=7d0df689d48744fa93e2a493f380a06a)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:06.418854 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2963cef8-9d4b-409b-9101-2ec92544499b None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:06.420752 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 196/381] 10.222.0.23 () {56 vars in 1180 bytes} [Thu Aug 18 19:28:06 2022] GET /identity/v3/groups/7d0df689d48744fa93e2a493f380a06a => generated 229 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:06.426818 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5e0837-8d16-49c6-9e46-499d7771fb31 None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:06.568732 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5e0837-8d16-49c6-9e46-499d7771fb31 None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:06.618350 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24843d58-3e7d-42c1-808e-dcf98872474b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:06.618967 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24843d58-3e7d-42c1-808e-dcf98872474b None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:06.619243 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24843d58-3e7d-42c1-808e-dcf98872474b None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:06.619510 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24843d58-3e7d-42c1-808e-dcf98872474b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:06.620227 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24843d58-3e7d-42c1-808e-dcf98872474b None admin] RBAC: Adding query filter params (group.id=7d0df689d48744fa93e2a493f380a06a, role.id=33fe6be3baf44b969c8166af5142e0c7, scope.project.id=df56ebe1a05047a7a4d05174a8a4c7f1) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:06.620532 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24843d58-3e7d-42c1-808e-dcf98872474b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:06.621989 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24843d58-3e7d-42c1-808e-dcf98872474b None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:06.627899 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 186/382] 10.222.0.23 () {56 vars in 1376 bytes} [Thu Aug 18 19:28:06 2022] GET /identity/v3/role_assignments?group.id=7d0df689d48744fa93e2a493f380a06a&scope.project.id=df56ebe1a05047a7a4d05174a8a4c7f1&role.id=33fe6be3baf44b969c8166af5142e0c7 => generated 260 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:06.709404 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2963cef8-9d4b-409b-9101-2ec92544499b None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:06.845106 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2963cef8-9d4b-409b-9101-2ec92544499b None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:06.848248 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:06.894898 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90be6978-ce98-4ad4-ab22-a3a4fe2af93a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:06.896454 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be6978-ce98-4ad4-ab22-a3a4fe2af93a None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:06.896975 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be6978-ce98-4ad4-ab22-a3a4fe2af93a None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:06.897462 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be6978-ce98-4ad4-ab22-a3a4fe2af93a None admin] PATH_INFO: `/v3/roles/member` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:06.919999 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90be6978-ce98-4ad4-ab22-a3a4fe2af93a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:28:06.932401 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application [None req-90be6978-ce98-4ad4-ab22-a3a4fe2af93a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 19:28:06.932401 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:06.932401 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:06.932401 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:06.932401 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:06.932401 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:06.932401 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:06.932401 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:06.932401 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:06.932401 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:06.932401 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:06.932401 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:06.932401 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:28:06.932401 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:28:06.932401 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:28:06.932401 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:28:06.933358 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:28:06.933358 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:28:06.933358 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:28:06.933358 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:28:06.933358 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:06.933358 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:06.933358 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:06.933358 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:06.933358 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:06.933358 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:06.933358 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:06.933358 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:06.933358 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:06.933358 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:06.933358 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:06.933358 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:06.934219 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:06.934219 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:06.934219 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:06.934219 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:06.934219 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:28:06.934219 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:28:06.934219 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:28:06.934219 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:28:06.934219 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:28:06.934219 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:28:06.934219 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 19:28:06.934219 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:28:06.934219 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 197/383] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Aug 18 19:28:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:28:06.942135 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24843d58-3e7d-42c1-808e-dcf98872474b None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:06.997456 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:07.104069 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24843d58-3e7d-42c1-808e-dcf98872474b None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:07.151064 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e908f631-9d14-4703-a050-125900f2517e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:07.151679 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e908f631-9d14-4703-a050-125900f2517e None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:07.151960 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e908f631-9d14-4703-a050-125900f2517e None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:07.152233 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e908f631-9d14-4703-a050-125900f2517e None admin] PATH_INFO: `/v3/roles` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:07.152892 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e908f631-9d14-4703-a050-125900f2517e None admin] RBAC: Adding query filter params (name=member) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:07.153194 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e908f631-9d14-4703-a050-125900f2517e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:07.154664 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e908f631-9d14-4703-a050-125900f2517e None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:07.163386 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 187/384] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Aug 18 19:28:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:07.169021 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90be6978-ce98-4ad4-ab22-a3a4fe2af93a None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:07.201517 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64a0171-91d4-433c-ab69-97b30c2d33c5 None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:07.202196 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64a0171-91d4-433c-ab69-97b30c2d33c5 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:07.202703 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64a0171-91d4-433c-ab69-97b30c2d33c5 None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:07.204299 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 188/385] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:28:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 19:28:07.210012 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8c1f71-b01c-47df-9243-7789742031d2 None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:07.210579 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8c1f71-b01c-47df-9243-7789742031d2 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:07.211047 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8c1f71-b01c-47df-9243-7789742031d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:07.239779 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-cb8c1f71-b01c-47df-9243-7789742031d2 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:28:07.241298 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-cb8c1f71-b01c-47df-9243-7789742031d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:28:07.296062 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90be6978-ce98-4ad4-ab22-a3a4fe2af93a None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:07.335601 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb2f477-a855-4a2b-9b7c-b803a451bbad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:07.336241 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb2f477-a855-4a2b-9b7c-b803a451bbad None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:07.336558 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb2f477-a855-4a2b-9b7c-b803a451bbad None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:07.336840 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb2f477-a855-4a2b-9b7c-b803a451bbad None admin] PATH_INFO: `/v3/groups/70f4cdfc68f04bca8b5b215dc175403c` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:07.338351 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb2f477-a855-4a2b-9b7c-b803a451bbad None admin] RBAC: Authorizing `identity:get_group(group_id=70f4cdfc68f04bca8b5b215dc175403c)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:07.339917 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb2f477-a855-4a2b-9b7c-b803a451bbad None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:07.341856 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 198/386] 10.222.0.23 () {56 vars in 1180 bytes} [Thu Aug 18 19:28:07 2022] GET /identity/v3/groups/70f4cdfc68f04bca8b5b215dc175403c => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:07.349690 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb2f477-a855-4a2b-9b7c-b803a451bbad None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:07.389691 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 189/387] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:28:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:28:07.399154 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:07.475351 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb2f477-a855-4a2b-9b7c-b803a451bbad None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:07.511361 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ec6d4d-6f7f-46cc-bf48-7f8056bed2dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:07.511994 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec6d4d-6f7f-46cc-bf48-7f8056bed2dd None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:07.512270 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec6d4d-6f7f-46cc-bf48-7f8056bed2dd None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:07.512541 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec6d4d-6f7f-46cc-bf48-7f8056bed2dd None admin] PATH_INFO: `/v3/projects/84c3b97bc50848039730cfaab66f74f9` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:07.513733 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ec6d4d-6f7f-46cc-bf48-7f8056bed2dd None admin] RBAC: Authorizing `identity:get_project(project_id=84c3b97bc50848039730cfaab66f74f9)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:07.515227 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ec6d4d-6f7f-46cc-bf48-7f8056bed2dd None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:07.517219 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 199/388] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Aug 18 19:28:07 2022] GET /identity/v3/projects/84c3b97bc50848039730cfaab66f74f9 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:28:07.523004 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8c1f71-b01c-47df-9243-7789742031d2 None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:07.553204 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:07.633876 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8c1f71-b01c-47df-9243-7789742031d2 None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:07.674777 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef10e796-afc1-4ce5-ae74-4a729e30bf46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:07.675450 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef10e796-afc1-4ce5-ae74-4a729e30bf46 None admin] REQUEST_METHOD: `PUT` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:07.675729 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef10e796-afc1-4ce5-ae74-4a729e30bf46 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:07.676002 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef10e796-afc1-4ce5-ae74-4a729e30bf46 None admin] PATH_INFO: `/v3/projects/84c3b97bc50848039730cfaab66f74f9/groups/70f4cdfc68f04bca8b5b215dc175403c/roles/ece5eb2bd1334192b3eee1b7b05c042c` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:07.677949 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef10e796-afc1-4ce5-ae74-4a729e30bf46 None admin] RBAC: Authorizing `identity:create_grant(project_id=84c3b97bc50848039730cfaab66f74f9, group_id=70f4cdfc68f04bca8b5b215dc175403c, role_id=ece5eb2bd1334192b3eee1b7b05c042c)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:07.679377 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef10e796-afc1-4ce5-ae74-4a729e30bf46 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:07.688439 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a81a631-e770-4247-9d96-d0cdac2ae1c1 None None] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:07.688721 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a81a631-e770-4247-9d96-d0cdac2ae1c1 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:07.689049 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a81a631-e770-4247-9d96-d0cdac2ae1c1 None None] PATH_INFO: `/` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:07.690780 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 200/389] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:28:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 19:28:07.695296 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a857cd1f-020b-4ea2-8369-11c3a25643da None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:07.695578 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a857cd1f-020b-4ea2-8369-11c3a25643da None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:07.695851 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a857cd1f-020b-4ea2-8369-11c3a25643da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:07.716844 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-a857cd1f-020b-4ea2-8369-11c3a25643da None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:28:07.718143 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-a857cd1f-020b-4ea2-8369-11c3a25643da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:28:07.760129 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 190/390] 10.222.0.23 () {58 vars in 1442 bytes} [Thu Aug 18 19:28:07 2022] PUT /identity/v3/projects/84c3b97bc50848039730cfaab66f74f9/groups/70f4cdfc68f04bca8b5b215dc175403c/roles/ece5eb2bd1334192b3eee1b7b05c042c => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 19:28:07.811332 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 201/391] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:28:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 19:28:07.895912 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef10e796-afc1-4ce5-ae74-4a729e30bf46 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:08.006792 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:08.021316 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef10e796-afc1-4ce5-ae74-4a729e30bf46 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:08.070177 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba2cab8-35d4-482f-b8d2-da60d4f5c569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:08.070903 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba2cab8-35d4-482f-b8d2-da60d4f5c569 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:08.071192 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba2cab8-35d4-482f-b8d2-da60d4f5c569 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:08.071471 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba2cab8-35d4-482f-b8d2-da60d4f5c569 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:08.083135 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba2cab8-35d4-482f-b8d2-da60d4f5c569 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:28:08.088299 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application [None req-1ba2cab8-35d4-482f-b8d2-da60d4f5c569 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 19:28:08.088299 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:08.088299 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:08.088299 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:08.088299 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:08.088299 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:08.088299 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:08.088299 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:08.088299 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:08.088299 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:08.088299 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:08.088299 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:08.088299 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:28:08.088299 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:28:08.088299 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:28:08.088299 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:28:08.089234 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:28:08.089234 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:28:08.089234 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:28:08.089234 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:28:08.089234 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:08.089234 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:08.089234 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:08.089234 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:08.089234 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:08.089234 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:08.089234 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:08.089234 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:08.089234 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:08.089234 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:08.089234 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:08.089234 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:08.090094 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:08.090094 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:08.090094 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:08.090094 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:08.090094 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:28:08.090094 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:28:08.090094 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:28:08.090094 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:28:08.090094 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:28:08.090094 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:28:08.090094 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 19:28:08.090094 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:28:08.093775 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 191/392] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Aug 18 19:28:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:28:08.096672 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a857cd1f-020b-4ea2-8369-11c3a25643da None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:08.144503 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:08.235669 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a857cd1f-020b-4ea2-8369-11c3a25643da None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:08.283089 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1eb91a-5cd2-40eb-9303-8d9b57e09bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:08.283681 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1eb91a-5cd2-40eb-9303-8d9b57e09bf2 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:08.283959 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1eb91a-5cd2-40eb-9303-8d9b57e09bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:08.284227 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1eb91a-5cd2-40eb-9303-8d9b57e09bf2 None admin] PATH_INFO: `/v3/roles` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:08.284895 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1eb91a-5cd2-40eb-9303-8d9b57e09bf2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:08.285197 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1eb91a-5cd2-40eb-9303-8d9b57e09bf2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:08.286587 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1eb91a-5cd2-40eb-9303-8d9b57e09bf2 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:08.295780 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 202/393] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Aug 18 19:28:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:08.302045 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba2cab8-35d4-482f-b8d2-da60d4f5c569 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:08.380084 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1eb91a-5cd2-40eb-9303-8d9b57e09bf2 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:08.470308 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba2cab8-35d4-482f-b8d2-da60d4f5c569 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:08.534775 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:08.542091 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1eb91a-5cd2-40eb-9303-8d9b57e09bf2 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:08.566933 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e507c959-7a8d-4e76-9fba-29d62eed20b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:08.569561 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e507c959-7a8d-4e76-9fba-29d62eed20b1 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:08.569561 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e507c959-7a8d-4e76-9fba-29d62eed20b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:08.569561 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e507c959-7a8d-4e76-9fba-29d62eed20b1 None admin] PATH_INFO: `/v3/groups/70f4cdfc68f04bca8b5b215dc175403c` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:08.570101 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e507c959-7a8d-4e76-9fba-29d62eed20b1 None admin] RBAC: Authorizing `identity:get_group(group_id=70f4cdfc68f04bca8b5b215dc175403c)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:08.571685 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e507c959-7a8d-4e76-9fba-29d62eed20b1 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:08.579666 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 192/394] 10.222.0.23 () {56 vars in 1180 bytes} [Thu Aug 18 19:28:08 2022] GET /identity/v3/groups/70f4cdfc68f04bca8b5b215dc175403c => generated 226 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:08.580490 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e532f5c5-3b8b-4ad4-aa81-30f5189a6bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:08.581141 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e532f5c5-3b8b-4ad4-aa81-30f5189a6bb6 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:08.581422 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e532f5c5-3b8b-4ad4-aa81-30f5189a6bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:08.581716 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e532f5c5-3b8b-4ad4-aa81-30f5189a6bb6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:08.582336 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e507c959-7a8d-4e76-9fba-29d62eed20b1 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:08.594319 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e532f5c5-3b8b-4ad4-aa81-30f5189a6bb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:28:08.600556 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application [None req-e532f5c5-3b8b-4ad4-aa81-30f5189a6bb6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 19:28:08.600556 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:08.600556 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:08.600556 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:08.600556 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:08.600556 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:08.600556 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:08.600556 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:08.600556 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:08.600556 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:08.600556 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:08.600556 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:08.600556 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:28:08.600556 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:28:08.600556 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:28:08.600556 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:28:08.601469 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:28:08.601469 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:28:08.601469 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:28:08.601469 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:28:08.601469 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:08.601469 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:08.601469 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:08.601469 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:08.601469 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:08.601469 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:08.601469 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:08.601469 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:08.601469 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:08.601469 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:08.601469 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:08.601469 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:08.603256 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:08.603256 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:08.603256 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:08.603256 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:08.603256 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:28:08.603256 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:28:08.603256 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:28:08.603256 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:28:08.603256 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:28:08.603256 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:28:08.603256 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 19:28:08.603256 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:28:08.603256 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 203/395] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Aug 18 19:28:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 19:28:08.612255 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e532f5c5-3b8b-4ad4-aa81-30f5189a6bb6 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:08.642021 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:08.775876 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e507c959-7a8d-4e76-9fba-29d62eed20b1 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:08.820338 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5adaaf-7096-42ca-8411-1e874ada6047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:08.821227 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5adaaf-7096-42ca-8411-1e874ada6047 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:08.822228 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5adaaf-7096-42ca-8411-1e874ada6047 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:08.823578 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5adaaf-7096-42ca-8411-1e874ada6047 None admin] PATH_INFO: `/v3/projects/84c3b97bc50848039730cfaab66f74f9` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:08.825143 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5adaaf-7096-42ca-8411-1e874ada6047 None admin] RBAC: Authorizing `identity:get_project(project_id=84c3b97bc50848039730cfaab66f74f9)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:08.827579 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5adaaf-7096-42ca-8411-1e874ada6047 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:08.831145 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 193/396] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Aug 18 19:28:08 2022] GET /identity/v3/projects/84c3b97bc50848039730cfaab66f74f9 => generated 298 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:08.840196 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5adaaf-7096-42ca-8411-1e874ada6047 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:08.864767 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e532f5c5-3b8b-4ad4-aa81-30f5189a6bb6 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:08.949856 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c5c225-3e3d-40f8-89e2-5d5ac35f6749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:08.950792 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c5c225-3e3d-40f8-89e2-5d5ac35f6749 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:08.951184 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c5c225-3e3d-40f8-89e2-5d5ac35f6749 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:08.951775 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c5c225-3e3d-40f8-89e2-5d5ac35f6749 None admin] PATH_INFO: `/v3/roles` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:08.953425 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c5c225-3e3d-40f8-89e2-5d5ac35f6749 None admin] RBAC: Adding query filter params (name=member) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:08.953425 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c5c225-3e3d-40f8-89e2-5d5ac35f6749 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:08.954471 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c5c225-3e3d-40f8-89e2-5d5ac35f6749 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:08.975331 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 204/397] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Aug 18 19:28:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:08.981004 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c5c225-3e3d-40f8-89e2-5d5ac35f6749 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:08.998008 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:09.032710 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:09.036559 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5adaaf-7096-42ca-8411-1e874ada6047 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:09.102207 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df1ce4b-81be-49a1-adc3-0f880a9a836e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:09.103225 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df1ce4b-81be-49a1-adc3-0f880a9a836e None admin] REQUEST_METHOD: `PUT` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:09.103766 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df1ce4b-81be-49a1-adc3-0f880a9a836e None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:09.104256 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df1ce4b-81be-49a1-adc3-0f880a9a836e None admin] PATH_INFO: `/v3/projects/84c3b97bc50848039730cfaab66f74f9/groups/70f4cdfc68f04bca8b5b215dc175403c/roles/629bead347a8449ebece758b5a7ae23d` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:09.108566 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df1ce4b-81be-49a1-adc3-0f880a9a836e None admin] RBAC: Authorizing `identity:create_grant(project_id=84c3b97bc50848039730cfaab66f74f9, group_id=70f4cdfc68f04bca8b5b215dc175403c, role_id=629bead347a8449ebece758b5a7ae23d)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:09.110894 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df1ce4b-81be-49a1-adc3-0f880a9a836e None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:09.164863 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c5c225-3e3d-40f8-89e2-5d5ac35f6749 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:09.201148 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 194/398] 10.222.0.23 () {58 vars in 1442 bytes} [Thu Aug 18 19:28:08 2022] PUT /identity/v3/projects/84c3b97bc50848039730cfaab66f74f9/groups/70f4cdfc68f04bca8b5b215dc175403c/roles/629bead347a8449ebece758b5a7ae23d => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 19:28:09.203504 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a52fda-aace-42dc-93ef-48286803cbcc None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:09.203970 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a52fda-aace-42dc-93ef-48286803cbcc None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:09.204435 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a52fda-aace-42dc-93ef-48286803cbcc None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:09.205512 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6890c77-2d31-40d0-82db-a111085b3c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:09.206273 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6890c77-2d31-40d0-82db-a111085b3c12 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:09.206563 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6890c77-2d31-40d0-82db-a111085b3c12 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:09.206837 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6890c77-2d31-40d0-82db-a111085b3c12 None admin] PATH_INFO: `/v3/groups/70f4cdfc68f04bca8b5b215dc175403c` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:09.206982 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 195/399] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:28:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:28:09.210630 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6890c77-2d31-40d0-82db-a111085b3c12 None admin] RBAC: Authorizing `identity:get_group(group_id=70f4cdfc68f04bca8b5b215dc175403c)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:09.210630 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6890c77-2d31-40d0-82db-a111085b3c12 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:09.215112 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee2fa2-8d05-42e0-af97-c59de4bfa0f8 None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:09.215471 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee2fa2-8d05-42e0-af97-c59de4bfa0f8 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:09.215823 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee2fa2-8d05-42e0-af97-c59de4bfa0f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:09.216872 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 205/400] 10.222.0.23 () {56 vars in 1180 bytes} [Thu Aug 18 19:28:08 2022] GET /identity/v3/groups/70f4cdfc68f04bca8b5b215dc175403c => generated 226 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:09.226277 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6890c77-2d31-40d0-82db-a111085b3c12 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:09.290785 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-47ee2fa2-8d05-42e0-af97-c59de4bfa0f8 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:28:09.303093 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-47ee2fa2-8d05-42e0-af97-c59de4bfa0f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:28:09.360738 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:09.382877 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6890c77-2d31-40d0-82db-a111085b3c12 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:09.434302 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1e65c3-6514-4e48-a877-cee8ccd0f163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:09.434954 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e65c3-6514-4e48-a877-cee8ccd0f163 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:09.435228 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e65c3-6514-4e48-a877-cee8ccd0f163 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:09.435500 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e65c3-6514-4e48-a877-cee8ccd0f163 None admin] PATH_INFO: `/v3/projects/f04621419eb84b00a435d700f145cf48` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:09.437442 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1e65c3-6514-4e48-a877-cee8ccd0f163 None admin] RBAC: Authorizing `identity:get_project(project_id=f04621419eb84b00a435d700f145cf48)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:09.438957 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1e65c3-6514-4e48-a877-cee8ccd0f163 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:09.440844 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 206/401] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Aug 18 19:28:09 2022] GET /identity/v3/projects/f04621419eb84b00a435d700f145cf48 => generated 302 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:09.451113 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1e65c3-6514-4e48-a877-cee8ccd0f163 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:09.477163 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 196/402] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:28:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:28:09.597155 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1e65c3-6514-4e48-a877-cee8ccd0f163 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:09.648948 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658d03c4-08ee-4e38-81d1-3aef13976815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:09.649913 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d03c4-08ee-4e38-81d1-3aef13976815 None admin] REQUEST_METHOD: `PUT` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:09.650327 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d03c4-08ee-4e38-81d1-3aef13976815 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:09.650730 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d03c4-08ee-4e38-81d1-3aef13976815 None admin] PATH_INFO: `/v3/projects/f04621419eb84b00a435d700f145cf48/groups/70f4cdfc68f04bca8b5b215dc175403c/roles/ece5eb2bd1334192b3eee1b7b05c042c` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:09.653096 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658d03c4-08ee-4e38-81d1-3aef13976815 None admin] RBAC: Authorizing `identity:create_grant(project_id=f04621419eb84b00a435d700f145cf48, group_id=70f4cdfc68f04bca8b5b215dc175403c, role_id=ece5eb2bd1334192b3eee1b7b05c042c)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:09.654848 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658d03c4-08ee-4e38-81d1-3aef13976815 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:09.763571 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 207/403] 10.222.0.23 () {58 vars in 1442 bytes} [Thu Aug 18 19:28:09 2022] PUT /identity/v3/projects/f04621419eb84b00a435d700f145cf48/groups/70f4cdfc68f04bca8b5b215dc175403c/roles/ece5eb2bd1334192b3eee1b7b05c042c => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 19:28:09.784908 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f860c9-4952-44a9-8eb4-b9627d4e1b84 None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:09.785348 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f860c9-4952-44a9-8eb4-b9627d4e1b84 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:09.785768 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f860c9-4952-44a9-8eb4-b9627d4e1b84 None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:09.787677 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 197/404] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:28:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:28:09.792900 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7363105-5f76-4fa7-99e2-00f5090a500d None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:09.793391 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7363105-5f76-4fa7-99e2-00f5090a500d None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:09.793919 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7363105-5f76-4fa7-99e2-00f5090a500d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:09.818921 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-f7363105-5f76-4fa7-99e2-00f5090a500d None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:28:09.820399 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-f7363105-5f76-4fa7-99e2-00f5090a500d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:28:09.823972 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:09.916538 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 208/405] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:28:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:28:09.975282 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f860c9-4952-44a9-8eb4-b9627d4e1b84 None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:10.072073 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:10.100980 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f860c9-4952-44a9-8eb4-b9627d4e1b84 None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:10.137705 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2034506-bd9e-4fdd-8665-b43d854c9458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:10.138393 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2034506-bd9e-4fdd-8665-b43d854c9458 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:10.138781 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2034506-bd9e-4fdd-8665-b43d854c9458 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:10.139110 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2034506-bd9e-4fdd-8665-b43d854c9458 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:10.154612 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2034506-bd9e-4fdd-8665-b43d854c9458 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:28:10.160111 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application [None req-a2034506-bd9e-4fdd-8665-b43d854c9458 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 19:28:10.160111 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:10.160111 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:10.160111 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:10.160111 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:10.160111 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:10.160111 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:10.160111 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:10.160111 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:10.160111 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:10.160111 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:10.160111 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:10.160111 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:28:10.160111 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:28:10.160111 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:28:10.160111 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:28:10.160970 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:28:10.160970 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:28:10.160970 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:28:10.160970 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:28:10.160970 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:10.160970 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:10.160970 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:10.160970 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:10.160970 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:10.160970 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:10.160970 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:10.160970 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:10.160970 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:10.160970 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:10.160970 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:10.160970 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:10.161782 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:10.161782 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:10.161782 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:10.161782 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:10.161782 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:28:10.161782 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:28:10.161782 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:28:10.161782 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:28:10.161782 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:28:10.161782 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:28:10.161782 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 19:28:10.161782 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:28:10.162833 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 198/406] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Aug 18 19:28:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:28:10.168720 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7363105-5f76-4fa7-99e2-00f5090a500d None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:10.318229 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7363105-5f76-4fa7-99e2-00f5090a500d None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:10.374354 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0718a931-6345-4c88-91d4-8d3bcd43b59d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:10.374968 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0718a931-6345-4c88-91d4-8d3bcd43b59d None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:10.375249 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0718a931-6345-4c88-91d4-8d3bcd43b59d None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:10.375524 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0718a931-6345-4c88-91d4-8d3bcd43b59d None admin] PATH_INFO: `/v3/roles` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:10.376187 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0718a931-6345-4c88-91d4-8d3bcd43b59d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:10.376492 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0718a931-6345-4c88-91d4-8d3bcd43b59d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:10.377893 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0718a931-6345-4c88-91d4-8d3bcd43b59d None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:10.389067 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 209/407] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Aug 18 19:28:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:10.395205 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2034506-bd9e-4fdd-8665-b43d854c9458 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:10.420312 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0718a931-6345-4c88-91d4-8d3bcd43b59d None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:10.423131 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:10.569892 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2034506-bd9e-4fdd-8665-b43d854c9458 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:10.607107 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e580f1-4838-43f1-a605-ae4a0f74f440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:10.608208 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e580f1-4838-43f1-a605-ae4a0f74f440 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:10.608785 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e580f1-4838-43f1-a605-ae4a0f74f440 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:10.609245 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e580f1-4838-43f1-a605-ae4a0f74f440 None admin] PATH_INFO: `/v3/groups/70f4cdfc68f04bca8b5b215dc175403c` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:10.610590 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e580f1-4838-43f1-a605-ae4a0f74f440 None admin] RBAC: Authorizing `identity:get_group(group_id=70f4cdfc68f04bca8b5b215dc175403c)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:10.611688 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0718a931-6345-4c88-91d4-8d3bcd43b59d None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:10.612438 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e580f1-4838-43f1-a605-ae4a0f74f440 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:10.617758 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 199/408] 10.222.0.23 () {56 vars in 1180 bytes} [Thu Aug 18 19:28:10 2022] GET /identity/v3/groups/70f4cdfc68f04bca8b5b215dc175403c => generated 226 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:10.620480 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e580f1-4838-43f1-a605-ae4a0f74f440 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:10.635368 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:10.689683 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553ebc13-190c-4964-8f3f-2281c350ffb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:10.690249 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553ebc13-190c-4964-8f3f-2281c350ffb9 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:10.690530 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553ebc13-190c-4964-8f3f-2281c350ffb9 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:10.690806 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553ebc13-190c-4964-8f3f-2281c350ffb9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:10.724845 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553ebc13-190c-4964-8f3f-2281c350ffb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:28:10.731441 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application [None req-553ebc13-190c-4964-8f3f-2281c350ffb9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 19:28:10.731441 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:10.731441 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:10.731441 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:10.731441 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:10.731441 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:10.731441 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:10.731441 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:10.731441 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:10.731441 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:10.731441 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:10.731441 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:10.731441 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:28:10.731441 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:28:10.731441 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:28:10.731441 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:28:10.732368 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:28:10.732368 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:28:10.732368 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:28:10.732368 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:28:10.732368 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:10.732368 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:10.732368 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:10.732368 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:10.732368 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:10.732368 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:10.732368 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:10.732368 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:10.732368 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:10.732368 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:10.732368 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:10.732368 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:10.733200 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:10.733200 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:10.733200 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:10.733200 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:10.733200 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:28:10.733200 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:28:10.733200 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:28:10.733200 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:28:10.733200 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:28:10.733200 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:28:10.733200 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 19:28:10.733200 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:28:10.738019 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 210/409] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Aug 18 19:28:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 19:28:10.743082 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553ebc13-190c-4964-8f3f-2281c350ffb9 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:10.764516 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e580f1-4838-43f1-a605-ae4a0f74f440 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:10.801630 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b426043-3807-4d68-80b5-1c5555885b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:10.802474 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b426043-3807-4d68-80b5-1c5555885b51 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:10.802886 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b426043-3807-4d68-80b5-1c5555885b51 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:10.803267 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b426043-3807-4d68-80b5-1c5555885b51 None admin] PATH_INFO: `/v3/projects/f04621419eb84b00a435d700f145cf48` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:10.804705 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b426043-3807-4d68-80b5-1c5555885b51 None admin] RBAC: Authorizing `identity:get_project(project_id=f04621419eb84b00a435d700f145cf48)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:10.806301 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b426043-3807-4d68-80b5-1c5555885b51 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:10.808719 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 200/410] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Aug 18 19:28:10 2022] GET /identity/v3/projects/f04621419eb84b00a435d700f145cf48 => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:28:10.809911 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:10.812469 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be91ff2a-ffee-4c4d-8e0c-0a345c8ddd2a None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:10.812905 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be91ff2a-ffee-4c4d-8e0c-0a345c8ddd2a None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:10.813188 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be91ff2a-ffee-4c4d-8e0c-0a345c8ddd2a None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:10.814608 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 201/411] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:28:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:28:10.819900 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be91ff2a-ffee-4c4d-8e0c-0a345c8ddd2a None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:10.857822 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553ebc13-190c-4964-8f3f-2281c350ffb9 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:10.893630 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61910b63-5f4a-494c-a3f9-a3e3d3528dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:10.894661 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61910b63-5f4a-494c-a3f9-a3e3d3528dbe None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:10.895175 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61910b63-5f4a-494c-a3f9-a3e3d3528dbe None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:10.895643 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61910b63-5f4a-494c-a3f9-a3e3d3528dbe None admin] PATH_INFO: `/v3/roles` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:10.896560 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61910b63-5f4a-494c-a3f9-a3e3d3528dbe None admin] RBAC: Adding query filter params (name=admin) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:10.897069 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61910b63-5f4a-494c-a3f9-a3e3d3528dbe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:10.898794 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61910b63-5f4a-494c-a3f9-a3e3d3528dbe None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:10.899373 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:10.908372 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 211/412] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Aug 18 19:28:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:10.910098 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb4c088-a194-4355-9adc-38e030d088eb None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:10.910631 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb4c088-a194-4355-9adc-38e030d088eb None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:10.911116 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb4c088-a194-4355-9adc-38e030d088eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:10.930861 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-1bb4c088-a194-4355-9adc-38e030d088eb None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:28:10.932393 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-1bb4c088-a194-4355-9adc-38e030d088eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:28:10.933852 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be91ff2a-ffee-4c4d-8e0c-0a345c8ddd2a None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:10.972309 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec944bf-7fc1-4de3-8317-3d1a5f92ba25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:10.973039 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec944bf-7fc1-4de3-8317-3d1a5f92ba25 None admin] REQUEST_METHOD: `PUT` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:10.973422 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec944bf-7fc1-4de3-8317-3d1a5f92ba25 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:10.973835 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec944bf-7fc1-4de3-8317-3d1a5f92ba25 None admin] PATH_INFO: `/v3/projects/f04621419eb84b00a435d700f145cf48/groups/70f4cdfc68f04bca8b5b215dc175403c/roles/629bead347a8449ebece758b5a7ae23d` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:10.976122 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec944bf-7fc1-4de3-8317-3d1a5f92ba25 None admin] RBAC: Authorizing `identity:create_grant(project_id=f04621419eb84b00a435d700f145cf48, group_id=70f4cdfc68f04bca8b5b215dc175403c, role_id=629bead347a8449ebece758b5a7ae23d)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:10.977963 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec944bf-7fc1-4de3-8317-3d1a5f92ba25 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:11.013680 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 212/413] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:28:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:28:11.013680 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb4c088-a194-4355-9adc-38e030d088eb None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:11.048552 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 202/414] 10.222.0.23 () {58 vars in 1442 bytes} [Thu Aug 18 19:28:10 2022] PUT /identity/v3/projects/f04621419eb84b00a435d700f145cf48/groups/70f4cdfc68f04bca8b5b215dc175403c/roles/629bead347a8449ebece758b5a7ae23d => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 19:28:11.097203 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:11.163139 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb4c088-a194-4355-9adc-38e030d088eb None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:11.217318 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d02bf8b-62d9-427a-94e4-0002e9b907b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:11.218085 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02bf8b-62d9-427a-94e4-0002e9b907b5 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:11.218306 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02bf8b-62d9-427a-94e4-0002e9b907b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:11.218585 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02bf8b-62d9-427a-94e4-0002e9b907b5 None admin] PATH_INFO: `/v3/groups/7d0df689d48744fa93e2a493f380a06a` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:11.219738 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d02bf8b-62d9-427a-94e4-0002e9b907b5 None admin] RBAC: Authorizing `identity:get_group(group_id=7d0df689d48744fa93e2a493f380a06a)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:11.221200 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d02bf8b-62d9-427a-94e4-0002e9b907b5 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:11.222871 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 213/415] 10.222.0.23 () {56 vars in 1180 bytes} [Thu Aug 18 19:28:11 2022] GET /identity/v3/groups/7d0df689d48744fa93e2a493f380a06a => generated 229 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:11.228553 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec944bf-7fc1-4de3-8317-3d1a5f92ba25 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:11.360153 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec944bf-7fc1-4de3-8317-3d1a5f92ba25 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:11.396205 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d02bf8b-62d9-427a-94e4-0002e9b907b5 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:11.398837 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:11.404350 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83051a3a-f5f2-406c-9b10-e232afe71084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:11.404989 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83051a3a-f5f2-406c-9b10-e232afe71084 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:11.405267 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83051a3a-f5f2-406c-9b10-e232afe71084 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:11.406107 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83051a3a-f5f2-406c-9b10-e232afe71084 None admin] PATH_INFO: `/v3/projects/df56ebe1a05047a7a4d05174a8a4c7f1` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:11.408521 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83051a3a-f5f2-406c-9b10-e232afe71084 None admin] RBAC: Authorizing `identity:get_project(project_id=df56ebe1a05047a7a4d05174a8a4c7f1)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:11.409971 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83051a3a-f5f2-406c-9b10-e232afe71084 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:11.412335 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 203/416] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Aug 18 19:28:11 2022] GET /identity/v3/projects/df56ebe1a05047a7a4d05174a8a4c7f1 => generated 344 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:11.417844 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83051a3a-f5f2-406c-9b10-e232afe71084 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:11.520478 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83051a3a-f5f2-406c-9b10-e232afe71084 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:11.556835 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e1f6bb-7835-476f-885e-9e861c523369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:11.557967 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e1f6bb-7835-476f-885e-9e861c523369 None admin] REQUEST_METHOD: `PUT` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:11.558466 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e1f6bb-7835-476f-885e-9e861c523369 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:11.558935 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e1f6bb-7835-476f-885e-9e861c523369 None admin] PATH_INFO: `/v3/projects/df56ebe1a05047a7a4d05174a8a4c7f1/groups/7d0df689d48744fa93e2a493f380a06a/roles/33fe6be3baf44b969c8166af5142e0c7` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:11.561278 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e1f6bb-7835-476f-885e-9e861c523369 None admin] RBAC: Authorizing `identity:create_grant(project_id=df56ebe1a05047a7a4d05174a8a4c7f1, group_id=7d0df689d48744fa93e2a493f380a06a, role_id=33fe6be3baf44b969c8166af5142e0c7)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:11.563063 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e1f6bb-7835-476f-885e-9e861c523369 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:11.590520 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d02bf8b-62d9-427a-94e4-0002e9b907b5 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:11.620253 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:11.630902 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f01d3-de54-4f89-bf5b-4653b23cce87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:11.631593 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f01d3-de54-4f89-bf5b-4653b23cce87 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:11.631876 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f01d3-de54-4f89-bf5b-4653b23cce87 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:11.632162 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f01d3-de54-4f89-bf5b-4653b23cce87 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:11.642856 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05f01d3-de54-4f89-bf5b-4653b23cce87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:28:11.648107 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application [None req-f05f01d3-de54-4f89-bf5b-4653b23cce87 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 19:28:11.648107 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:11.648107 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:11.648107 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:11.648107 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:11.648107 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:11.648107 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:11.648107 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:11.648107 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:11.648107 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:11.648107 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:11.648107 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:11.648107 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:28:11.648107 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:28:11.648107 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:28:11.648107 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:28:11.649060 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:28:11.649060 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:28:11.649060 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:28:11.649060 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:28:11.649060 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:11.649060 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:11.649060 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:11.649060 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:11.649060 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:11.649060 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:11.649060 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:11.649060 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:11.649060 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:11.649060 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:11.649060 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:11.649060 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:11.649862 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:11.649862 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:11.649862 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:11.649862 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:11.649862 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:28:11.649862 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:28:11.649862 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:28:11.649862 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:28:11.649862 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:28:11.649862 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:28:11.649862 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 19:28:11.649862 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:28:11.649862 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 214/417] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Aug 18 19:28:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:28:11.652872 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 204/418] 10.222.0.23 () {58 vars in 1442 bytes} [Thu Aug 18 19:28:11 2022] PUT /identity/v3/projects/df56ebe1a05047a7a4d05174a8a4c7f1/groups/7d0df689d48744fa93e2a493f380a06a/roles/33fe6be3baf44b969c8166af5142e0c7 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 19:28:11.654959 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f01d3-de54-4f89-bf5b-4653b23cce87 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:11.794240 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f01d3-de54-4f89-bf5b-4653b23cce87 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:11.833000 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946c9bf0-7429-4b6f-ad9f-a67a5e61d1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:11.833616 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946c9bf0-7429-4b6f-ad9f-a67a5e61d1f0 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:11.834100 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946c9bf0-7429-4b6f-ad9f-a67a5e61d1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:11.834375 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946c9bf0-7429-4b6f-ad9f-a67a5e61d1f0 None admin] PATH_INFO: `/v3/roles` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:11.835183 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946c9bf0-7429-4b6f-ad9f-a67a5e61d1f0 None admin] RBAC: Adding query filter params (name=member) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:11.835485 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946c9bf0-7429-4b6f-ad9f-a67a5e61d1f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:11.836924 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946c9bf0-7429-4b6f-ad9f-a67a5e61d1f0 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:11.847729 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 215/419] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Aug 18 19:28:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:11.853612 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e1f6bb-7835-476f-885e-9e861c523369 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:11.920002 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:11.974191 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e1f6bb-7835-476f-885e-9e861c523369 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:12.018972 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6145fde-7780-4db8-aefe-c7768b77d9d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:12.019604 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6145fde-7780-4db8-aefe-c7768b77d9d6 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:12.019939 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6145fde-7780-4db8-aefe-c7768b77d9d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:12.020216 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6145fde-7780-4db8-aefe-c7768b77d9d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:12.123614 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed9388b-e663-4de6-a597-3e3976aec33f None None] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:12.123906 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed9388b-e663-4de6-a597-3e3976aec33f None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:12.124714 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed9388b-e663-4de6-a597-3e3976aec33f None None] PATH_INFO: `/` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:12.129769 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 216/420] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:28:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:28:12.131433 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfadc93-1965-40e4-a324-a33eb451017f None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:12.131718 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfadc93-1965-40e4-a324-a33eb451017f None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:12.131996 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfadc93-1965-40e4-a324-a33eb451017f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:12.132997 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6145fde-7780-4db8-aefe-c7768b77d9d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:12.134788 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6145fde-7780-4db8-aefe-c7768b77d9d6 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:12.150628 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-5cfadc93-1965-40e4-a324-a33eb451017f None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:28:12.151810 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-5cfadc93-1965-40e4-a324-a33eb451017f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:28:12.201342 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:12.238189 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 217/421] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:28:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 19:28:12.247273 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:12.309106 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 205/422] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Aug 18 19:28:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 19:28:12.315460 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfadc93-1965-40e4-a324-a33eb451017f None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:12.433723 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfadc93-1965-40e4-a324-a33eb451017f None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:12.477163 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c38c95-2181-4839-afc0-e21dc89fb00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:12.478185 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c38c95-2181-4839-afc0-e21dc89fb00c None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:12.478647 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c38c95-2181-4839-afc0-e21dc89fb00c None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:12.479095 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c38c95-2181-4839-afc0-e21dc89fb00c None admin] PATH_INFO: `/v3/projects/84c3b97bc50848039730cfaab66f74f9` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:12.486336 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c38c95-2181-4839-afc0-e21dc89fb00c None admin] RBAC: Authorizing `identity:get_project(project_id=84c3b97bc50848039730cfaab66f74f9)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:12.487993 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c38c95-2181-4839-afc0-e21dc89fb00c None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:12.490177 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 218/423] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Aug 18 19:28:12 2022] GET /identity/v3/projects/84c3b97bc50848039730cfaab66f74f9 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:12.494648 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd520d7-a6d5-4d2d-8139-4776cc880c9a None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:12.495141 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd520d7-a6d5-4d2d-8139-4776cc880c9a None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:12.495595 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd520d7-a6d5-4d2d-8139-4776cc880c9a None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:12.497118 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 206/424] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:28:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:28:12.498176 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c38c95-2181-4839-afc0-e21dc89fb00c None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:12.519258 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedfb883-5c78-4cd8-b816-4eb2d6febd3b None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:12.519644 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedfb883-5c78-4cd8-b816-4eb2d6febd3b None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:12.519996 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedfb883-5c78-4cd8-b816-4eb2d6febd3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:12.555592 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-dedfb883-5c78-4cd8-b816-4eb2d6febd3b None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:28:12.557120 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-dedfb883-5c78-4cd8-b816-4eb2d6febd3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:28:12.563796 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:12.647409 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c38c95-2181-4839-afc0-e21dc89fb00c None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:12.683458 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5925d9c7-feab-44e4-aca6-a3ec81f0c7ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:12.684152 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925d9c7-feab-44e4-aca6-a3ec81f0c7ef None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:12.684370 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925d9c7-feab-44e4-aca6-a3ec81f0c7ef None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:12.684467 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 207/425] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:28:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:28:12.684642 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925d9c7-feab-44e4-aca6-a3ec81f0c7ef None admin] PATH_INFO: `/v3/groups/70f4cdfc68f04bca8b5b215dc175403c` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:12.685220 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedfb883-5c78-4cd8-b816-4eb2d6febd3b None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:12.685787 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5925d9c7-feab-44e4-aca6-a3ec81f0c7ef None admin] RBAC: Authorizing `identity:get_group(group_id=70f4cdfc68f04bca8b5b215dc175403c)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:12.688016 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5925d9c7-feab-44e4-aca6-a3ec81f0c7ef None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:12.689951 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 219/426] 10.222.0.23 () {56 vars in 1180 bytes} [Thu Aug 18 19:28:12 2022] GET /identity/v3/groups/70f4cdfc68f04bca8b5b215dc175403c => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:12.695530 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5925d9c7-feab-44e4-aca6-a3ec81f0c7ef None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:12.778329 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:12.791971 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedfb883-5c78-4cd8-b816-4eb2d6febd3b None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:12.801465 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5925d9c7-feab-44e4-aca6-a3ec81f0c7ef None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:12.814849 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:12.847997 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddd5751-8ac1-47fc-a3d2-daa88e071d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:12.848614 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd5751-8ac1-47fc-a3d2-daa88e071d0e None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:12.848895 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd5751-8ac1-47fc-a3d2-daa88e071d0e None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:12.849166 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd5751-8ac1-47fc-a3d2-daa88e071d0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:12.849917 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddd5751-8ac1-47fc-a3d2-daa88e071d0e None admin] RBAC: Adding query filter params (group.id=70f4cdfc68f04bca8b5b215dc175403c, role.id=ece5eb2bd1334192b3eee1b7b05c042c, scope.project.id=84c3b97bc50848039730cfaab66f74f9) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:12.850225 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddd5751-8ac1-47fc-a3d2-daa88e071d0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:12.851710 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddd5751-8ac1-47fc-a3d2-daa88e071d0e None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:12.857811 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 220/427] 10.222.0.23 () {56 vars in 1376 bytes} [Thu Aug 18 19:28:12 2022] GET /identity/v3/role_assignments?group.id=70f4cdfc68f04bca8b5b215dc175403c&scope.project.id=84c3b97bc50848039730cfaab66f74f9&role.id=ece5eb2bd1334192b3eee1b7b05c042c => generated 611 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:12.874574 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489f178d-8a45-4cba-9430-64e3fe4d223b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:12.875236 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489f178d-8a45-4cba-9430-64e3fe4d223b None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:12.875517 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489f178d-8a45-4cba-9430-64e3fe4d223b None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:12.875787 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489f178d-8a45-4cba-9430-64e3fe4d223b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:12.902382 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489f178d-8a45-4cba-9430-64e3fe4d223b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:28:12.907813 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application [None req-489f178d-8a45-4cba-9430-64e3fe4d223b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 19:28:12.907813 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:12.907813 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:12.907813 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:12.907813 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:12.907813 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:12.907813 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:12.907813 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:12.907813 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:12.907813 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:12.907813 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:12.907813 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:12.907813 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:28:12.907813 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:28:12.907813 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:28:12.907813 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:28:12.909267 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:28:12.909267 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:28:12.909267 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:28:12.909267 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:28:12.909267 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:12.909267 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:12.909267 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:12.909267 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:12.909267 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:12.909267 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:12.909267 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:12.909267 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:12.909267 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:12.909267 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:12.909267 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:12.909267 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:12.911313 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:12.911313 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:12.911313 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:12.911313 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:12.911313 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:28:12.911313 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:28:12.911313 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:28:12.911313 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:28:12.911313 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:28:12.911313 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:28:12.911313 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 19:28:12.911313 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:28:12.916548 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 208/428] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Aug 18 19:28:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:28:12.916809 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddd5751-8ac1-47fc-a3d2-daa88e071d0e None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:13.055076 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489f178d-8a45-4cba-9430-64e3fe4d223b None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:13.091871 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddd5751-8ac1-47fc-a3d2-daa88e071d0e None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:13.143620 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d3770b-3cec-422c-ad93-6557b5b614e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:13.145416 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d3770b-3cec-422c-ad93-6557b5b614e1 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:13.146635 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d3770b-3cec-422c-ad93-6557b5b614e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:13.147957 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d3770b-3cec-422c-ad93-6557b5b614e1 None admin] PATH_INFO: `/v3/roles` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:13.148831 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d3770b-3cec-422c-ad93-6557b5b614e1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:13.149504 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d3770b-3cec-422c-ad93-6557b5b614e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:13.151326 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d3770b-3cec-422c-ad93-6557b5b614e1 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:13.161609 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 221/429] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Aug 18 19:28:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:13.166907 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d3770b-3cec-422c-ad93-6557b5b614e1 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:13.211525 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:13.212167 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489f178d-8a45-4cba-9430-64e3fe4d223b None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:13.266677 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19812471-d4ff-496c-8164-a7ad2b93c6ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:13.267404 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19812471-d4ff-496c-8164-a7ad2b93c6ca None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:13.267793 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19812471-d4ff-496c-8164-a7ad2b93c6ca None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:13.269815 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19812471-d4ff-496c-8164-a7ad2b93c6ca None admin] PATH_INFO: `/v3/roles/member` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:13.290445 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19812471-d4ff-496c-8164-a7ad2b93c6ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:28:13.297520 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application [None req-19812471-d4ff-496c-8164-a7ad2b93c6ca None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 19:28:13.297520 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:13.297520 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:13.297520 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:13.297520 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:13.297520 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:13.297520 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:13.297520 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:13.297520 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:13.297520 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:13.297520 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:13.297520 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:13.297520 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:28:13.297520 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:28:13.297520 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:28:13.297520 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:28:13.300858 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:28:13.300858 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:28:13.300858 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:28:13.300858 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:28:13.300858 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:13.300858 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:13.300858 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:13.300858 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:13.300858 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:13.300858 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:13.300858 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:13.300858 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:13.300858 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:13.300858 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:13.300858 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:13.300858 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:13.301706 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:13.301706 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:13.301706 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:13.301706 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:13.301706 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:28:13.301706 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:28:13.301706 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:28:13.301706 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:28:13.301706 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:28:13.301706 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:28:13.301706 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 19:28:13.301706 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:28:13.304347 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 209/430] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Aug 18 19:28:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 19:28:13.305619 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d3770b-3cec-422c-ad93-6557b5b614e1 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:13.309808 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19812471-d4ff-496c-8164-a7ad2b93c6ca None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:13.321527 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:13.348188 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f993e3-a630-4583-a034-0a1b78b9a71a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:13.348796 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f993e3-a630-4583-a034-0a1b78b9a71a None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:13.349077 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f993e3-a630-4583-a034-0a1b78b9a71a None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:13.349347 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f993e3-a630-4583-a034-0a1b78b9a71a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:13.441006 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19812471-d4ff-496c-8164-a7ad2b93c6ca None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:13.441549 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f993e3-a630-4583-a034-0a1b78b9a71a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:13.443203 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f993e3-a630-4583-a034-0a1b78b9a71a None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:13.487937 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:13.490292 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c65625-abe5-4cce-9f3f-7fada4ffcd10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:13.490917 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c65625-abe5-4cce-9f3f-7fada4ffcd10 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:13.491203 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c65625-abe5-4cce-9f3f-7fada4ffcd10 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:13.491477 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c65625-abe5-4cce-9f3f-7fada4ffcd10 None admin] PATH_INFO: `/v3/roles` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:13.492147 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c65625-abe5-4cce-9f3f-7fada4ffcd10 None admin] RBAC: Adding query filter params (name=member) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:13.492453 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c65625-abe5-4cce-9f3f-7fada4ffcd10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:13.493851 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c65625-abe5-4cce-9f3f-7fada4ffcd10 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:13.504576 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 210/431] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Aug 18 19:28:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:28:13.510194 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c65625-abe5-4cce-9f3f-7fada4ffcd10 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:13.575570 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 222/432] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Aug 18 19:28:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 19:28:13.581493 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f993e3-a630-4583-a034-0a1b78b9a71a None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:13.598555 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:13.650858 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c65625-abe5-4cce-9f3f-7fada4ffcd10 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:13.702718 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4839964b-94ce-4cfb-9601-f6d36e906ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:13.703360 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4839964b-94ce-4cfb-9601-f6d36e906ccb None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:13.703660 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4839964b-94ce-4cfb-9601-f6d36e906ccb None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:13.703932 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4839964b-94ce-4cfb-9601-f6d36e906ccb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:13.714130 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f993e3-a630-4583-a034-0a1b78b9a71a None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:13.762636 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49581664-51b4-4759-8231-2f4ecbdf3d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:13.763915 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49581664-51b4-4759-8231-2f4ecbdf3d52 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:13.764191 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49581664-51b4-4759-8231-2f4ecbdf3d52 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:13.764555 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49581664-51b4-4759-8231-2f4ecbdf3d52 None admin] PATH_INFO: `/v3/projects/84c3b97bc50848039730cfaab66f74f9` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:13.766275 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49581664-51b4-4759-8231-2f4ecbdf3d52 None admin] RBAC: Authorizing `identity:get_project(project_id=84c3b97bc50848039730cfaab66f74f9)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:13.767815 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49581664-51b4-4759-8231-2f4ecbdf3d52 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:13.769866 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 223/433] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Aug 18 19:28:13 2022] GET /identity/v3/projects/84c3b97bc50848039730cfaab66f74f9 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:28:13.775250 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49581664-51b4-4759-8231-2f4ecbdf3d52 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:13.779134 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:13.791586 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4839964b-94ce-4cfb-9601-f6d36e906ccb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:13.796388 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4839964b-94ce-4cfb-9601-f6d36e906ccb None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:13.872238 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:13.886411 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49581664-51b4-4759-8231-2f4ecbdf3d52 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:13.905628 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 211/434] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Aug 18 19:28:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 18 19:28:13.907080 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddd7aaf-b590-4892-b241-30809236376a None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:13.907368 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddd7aaf-b590-4892-b241-30809236376a None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:13.907636 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddd7aaf-b590-4892-b241-30809236376a None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:13.909003 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 212/435] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:28:13 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:28:13.913490 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddd7aaf-b590-4892-b241-30809236376a None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:13.925997 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ae6c72-6a90-47e4-8f50-cef37ab0a43b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:13.926743 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ae6c72-6a90-47e4-8f50-cef37ab0a43b None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:13.927025 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ae6c72-6a90-47e4-8f50-cef37ab0a43b None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:13.927295 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ae6c72-6a90-47e4-8f50-cef37ab0a43b None admin] PATH_INFO: `/v3/groups/70f4cdfc68f04bca8b5b215dc175403c` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:13.928403 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ae6c72-6a90-47e4-8f50-cef37ab0a43b None admin] RBAC: Authorizing `identity:get_group(group_id=70f4cdfc68f04bca8b5b215dc175403c)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:13.929862 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ae6c72-6a90-47e4-8f50-cef37ab0a43b None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:13.931417 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 224/436] 10.222.0.23 () {56 vars in 1180 bytes} [Thu Aug 18 19:28:13 2022] GET /identity/v3/groups/70f4cdfc68f04bca8b5b215dc175403c => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:28:13.932507 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee277b3b-e74b-4f35-a398-d92cf7b5a165 None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:13.932909 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee277b3b-e74b-4f35-a398-d92cf7b5a165 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:13.933175 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee277b3b-e74b-4f35-a398-d92cf7b5a165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:13.951504 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-ee277b3b-e74b-4f35-a398-d92cf7b5a165 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:28:13.952703 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-ee277b3b-e74b-4f35-a398-d92cf7b5a165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:28:14.022053 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 225/437] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:28:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:28:14.023696 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee277b3b-e74b-4f35-a398-d92cf7b5a165 None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:14.030509 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddd7aaf-b590-4892-b241-30809236376a None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:14.031061 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:14.075607 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd928339-e859-4d0e-9eae-a0389dd5e19d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:14.076244 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd928339-e859-4d0e-9eae-a0389dd5e19d None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:14.076516 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd928339-e859-4d0e-9eae-a0389dd5e19d None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:14.076785 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd928339-e859-4d0e-9eae-a0389dd5e19d None admin] PATH_INFO: `/v3/projects/f04621419eb84b00a435d700f145cf48` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:14.077964 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd928339-e859-4d0e-9eae-a0389dd5e19d None admin] RBAC: Authorizing `identity:get_project(project_id=f04621419eb84b00a435d700f145cf48)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:14.079449 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd928339-e859-4d0e-9eae-a0389dd5e19d None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:14.085730 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 213/438] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Aug 18 19:28:13 2022] GET /identity/v3/projects/f04621419eb84b00a435d700f145cf48 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:14.086583 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd928339-e859-4d0e-9eae-a0389dd5e19d None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:14.128130 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:14.140740 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee277b3b-e74b-4f35-a398-d92cf7b5a165 None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:14.183543 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164f8c5c-2157-4cbe-b78f-a0296ba65258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:14.184643 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164f8c5c-2157-4cbe-b78f-a0296ba65258 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:14.185463 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164f8c5c-2157-4cbe-b78f-a0296ba65258 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:14.186176 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164f8c5c-2157-4cbe-b78f-a0296ba65258 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:14.187610 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164f8c5c-2157-4cbe-b78f-a0296ba65258 None admin] RBAC: Adding query filter params (group.id=70f4cdfc68f04bca8b5b215dc175403c, role.id=629bead347a8449ebece758b5a7ae23d, scope.project.id=84c3b97bc50848039730cfaab66f74f9) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:14.188320 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164f8c5c-2157-4cbe-b78f-a0296ba65258 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:14.190568 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164f8c5c-2157-4cbe-b78f-a0296ba65258 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:14.191565 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd928339-e859-4d0e-9eae-a0389dd5e19d None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:14.198539 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 226/439] 10.222.0.23 () {56 vars in 1376 bytes} [Thu Aug 18 19:28:14 2022] GET /identity/v3/role_assignments?group.id=70f4cdfc68f04bca8b5b215dc175403c&scope.project.id=84c3b97bc50848039730cfaab66f74f9&role.id=629bead347a8449ebece758b5a7ae23d => generated 611 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:14.235866 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c792f079-b1b5-478c-874b-7a65b848271f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:14.236517 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c792f079-b1b5-478c-874b-7a65b848271f None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:14.236794 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c792f079-b1b5-478c-874b-7a65b848271f None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:14.237060 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c792f079-b1b5-478c-874b-7a65b848271f None admin] PATH_INFO: `/v3/groups/70f4cdfc68f04bca8b5b215dc175403c` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:14.238278 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c792f079-b1b5-478c-874b-7a65b848271f None admin] RBAC: Authorizing `identity:get_group(group_id=70f4cdfc68f04bca8b5b215dc175403c)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:14.239763 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c792f079-b1b5-478c-874b-7a65b848271f None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:14.241400 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 214/440] 10.222.0.23 () {56 vars in 1180 bytes} [Thu Aug 18 19:28:14 2022] GET /identity/v3/groups/70f4cdfc68f04bca8b5b215dc175403c => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:14.247683 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164f8c5c-2157-4cbe-b78f-a0296ba65258 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:14.320605 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:14.364322 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164f8c5c-2157-4cbe-b78f-a0296ba65258 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:14.396088 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c792f079-b1b5-478c-874b-7a65b848271f None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:14.406426 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b078e51-ab13-41bb-8d5d-a93eec6591c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:14.407051 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b078e51-ab13-41bb-8d5d-a93eec6591c8 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:14.407329 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b078e51-ab13-41bb-8d5d-a93eec6591c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:14.407601 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b078e51-ab13-41bb-8d5d-a93eec6591c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:14.408327 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b078e51-ab13-41bb-8d5d-a93eec6591c8 None admin] RBAC: Adding query filter params (group.id=70f4cdfc68f04bca8b5b215dc175403c, role.id=ece5eb2bd1334192b3eee1b7b05c042c, scope.project.id=f04621419eb84b00a435d700f145cf48) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:14.408635 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b078e51-ab13-41bb-8d5d-a93eec6591c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:14.410107 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b078e51-ab13-41bb-8d5d-a93eec6591c8 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:14.417255 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 227/441] 10.222.0.23 () {56 vars in 1376 bytes} [Thu Aug 18 19:28:14 2022] GET /identity/v3/role_assignments?group.id=70f4cdfc68f04bca8b5b215dc175403c&scope.project.id=f04621419eb84b00a435d700f145cf48&role.id=ece5eb2bd1334192b3eee1b7b05c042c => generated 611 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:14.518370 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c792f079-b1b5-478c-874b-7a65b848271f None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:14.527259 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:14.542780 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5161a96-c15d-46c2-b928-f7d63c1f9ceb None None] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:14.543524 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5161a96-c15d-46c2-b928-f7d63c1f9ceb None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:14.543882 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5161a96-c15d-46c2-b928-f7d63c1f9ceb None None] PATH_INFO: `/` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:14.545369 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 228/442] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:28:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:28:14.553319 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a7509f-df05-4b38-b8ec-560c755514c4 None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:14.553613 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a7509f-df05-4b38-b8ec-560c755514c4 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:14.554001 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a7509f-df05-4b38-b8ec-560c755514c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:14.559760 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d849510c-947b-47ab-865c-6efa11b636df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:14.565637 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d849510c-947b-47ab-865c-6efa11b636df None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:14.565637 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d849510c-947b-47ab-865c-6efa11b636df None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:14.565637 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d849510c-947b-47ab-865c-6efa11b636df None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:14.580806 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d849510c-947b-47ab-865c-6efa11b636df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:28:14.582816 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-64a7509f-df05-4b38-b8ec-560c755514c4 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:28:14.583421 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-64a7509f-df05-4b38-b8ec-560c755514c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:28:14.583811 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application [None req-d849510c-947b-47ab-865c-6efa11b636df None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 19:28:14.583811 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:14.583811 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:14.583811 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:14.583811 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:14.583811 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:14.583811 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:14.583811 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:14.583811 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:14.583811 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:14.583811 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:14.583811 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:14.583811 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:28:14.583811 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:28:14.583811 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:28:14.583811 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:28:14.584670 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:28:14.584670 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:28:14.584670 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:28:14.584670 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:28:14.584670 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:14.584670 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:14.584670 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:14.584670 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:14.584670 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:14.584670 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:14.584670 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:14.584670 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:14.584670 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:14.584670 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:14.584670 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:14.584670 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:14.585895 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:14.585895 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:14.585895 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:14.585895 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:14.585895 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:28:14.585895 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:28:14.585895 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:28:14.585895 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:28:14.585895 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:28:14.585895 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:28:14.585895 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 19:28:14.585895 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:28:14.585895 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 215/443] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Aug 18 19:28:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:28:14.591669 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d849510c-947b-47ab-865c-6efa11b636df None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:14.679019 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 229/444] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:28:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:28:14.724757 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d849510c-947b-47ab-865c-6efa11b636df None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:14.758417 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d152ecd-a644-45da-9844-66ae13a01708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:14.759024 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d152ecd-a644-45da-9844-66ae13a01708 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:14.759301 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d152ecd-a644-45da-9844-66ae13a01708 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:14.759572 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d152ecd-a644-45da-9844-66ae13a01708 None admin] PATH_INFO: `/v3/roles` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:14.760223 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d152ecd-a644-45da-9844-66ae13a01708 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:14.760528 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d152ecd-a644-45da-9844-66ae13a01708 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:14.761921 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d152ecd-a644-45da-9844-66ae13a01708 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:14.770721 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 216/445] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Aug 18 19:28:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:28:14.776334 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a7509f-df05-4b38-b8ec-560c755514c4 None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:14.841471 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:14.882706 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a7509f-df05-4b38-b8ec-560c755514c4 None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:14.917337 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9955633e-ad83-4fea-9c7c-b371eca088f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:14.917973 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9955633e-ad83-4fea-9c7c-b371eca088f3 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:14.918246 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9955633e-ad83-4fea-9c7c-b371eca088f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:14.918536 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9955633e-ad83-4fea-9c7c-b371eca088f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:14.984181 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9955633e-ad83-4fea-9c7c-b371eca088f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:14.985545 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9955633e-ad83-4fea-9c7c-b371eca088f3 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:15.005301 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d152ecd-a644-45da-9844-66ae13a01708 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:15.038347 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:15.044718 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:15.088358 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 230/446] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Aug 18 19:28:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 19:28:15.094047 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9955633e-ad83-4fea-9c7c-b371eca088f3 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:15.115987 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d152ecd-a644-45da-9844-66ae13a01708 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:15.149583 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c39da10-7de2-4f99-b898-ef0460dcfa01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:15.150239 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c39da10-7de2-4f99-b898-ef0460dcfa01 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:15.150517 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c39da10-7de2-4f99-b898-ef0460dcfa01 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:15.150785 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c39da10-7de2-4f99-b898-ef0460dcfa01 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:15.160689 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c39da10-7de2-4f99-b898-ef0460dcfa01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:28:15.165870 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application [None req-6c39da10-7de2-4f99-b898-ef0460dcfa01 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 19:28:15.165870 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:15.165870 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:15.165870 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:15.165870 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:15.165870 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:15.165870 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:15.165870 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:15.165870 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:15.165870 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:15.165870 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:15.165870 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:15.165870 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:28:15.165870 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:28:15.165870 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:28:15.165870 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:28:15.166783 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:28:15.166783 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:28:15.166783 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:28:15.166783 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:28:15.166783 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:15.166783 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:15.166783 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:15.166783 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:15.166783 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:15.166783 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:15.166783 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:15.166783 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:15.166783 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:15.166783 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:15.166783 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:15.166783 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:15.167570 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:15.167570 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:15.167570 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:15.167570 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:15.167570 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:28:15.167570 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:28:15.167570 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:28:15.167570 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:28:15.167570 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:28:15.167570 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:28:15.167570 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 19:28:15.167570 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:28:15.167570 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 217/447] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Aug 18 19:28:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 19:28:15.172719 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c39da10-7de2-4f99-b898-ef0460dcfa01 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:15.195179 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9955633e-ad83-4fea-9c7c-b371eca088f3 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:15.228660 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233e75b0-5b0f-41ad-be23-320c690a0377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:15.229282 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233e75b0-5b0f-41ad-be23-320c690a0377 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:15.229563 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233e75b0-5b0f-41ad-be23-320c690a0377 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:15.229868 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233e75b0-5b0f-41ad-be23-320c690a0377 None admin] PATH_INFO: `/v3/projects/f04621419eb84b00a435d700f145cf48` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:15.230989 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233e75b0-5b0f-41ad-be23-320c690a0377 None admin] RBAC: Authorizing `identity:get_project(project_id=f04621419eb84b00a435d700f145cf48)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:15.232426 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233e75b0-5b0f-41ad-be23-320c690a0377 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:15.234108 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 231/448] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Aug 18 19:28:15 2022] GET /identity/v3/projects/f04621419eb84b00a435d700f145cf48 => generated 302 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:28:15.239496 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233e75b0-5b0f-41ad-be23-320c690a0377 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:15.261505 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:15.268060 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:15.273676 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c39da10-7de2-4f99-b898-ef0460dcfa01 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:15.306072 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3407bbd1-a32d-47db-9459-0e4a2cef60c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:15.306669 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3407bbd1-a32d-47db-9459-0e4a2cef60c4 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:15.306945 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3407bbd1-a32d-47db-9459-0e4a2cef60c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:15.307213 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3407bbd1-a32d-47db-9459-0e4a2cef60c4 None admin] PATH_INFO: `/v3/roles` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:15.307858 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3407bbd1-a32d-47db-9459-0e4a2cef60c4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:15.308157 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3407bbd1-a32d-47db-9459-0e4a2cef60c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:15.309509 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3407bbd1-a32d-47db-9459-0e4a2cef60c4 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:15.318048 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 218/449] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Aug 18 19:28:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:15.323801 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3407bbd1-a32d-47db-9459-0e4a2cef60c4 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:15.337750 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233e75b0-5b0f-41ad-be23-320c690a0377 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:15.370417 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b007803-a5b0-4226-9dff-72679086affa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:15.371034 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b007803-a5b0-4226-9dff-72679086affa None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:15.371306 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b007803-a5b0-4226-9dff-72679086affa None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:15.371573 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b007803-a5b0-4226-9dff-72679086affa None admin] PATH_INFO: `/v3/groups/70f4cdfc68f04bca8b5b215dc175403c` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:15.372665 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b007803-a5b0-4226-9dff-72679086affa None admin] RBAC: Authorizing `identity:get_group(group_id=70f4cdfc68f04bca8b5b215dc175403c)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:15.374667 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b007803-a5b0-4226-9dff-72679086affa None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:15.376205 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 232/450] 10.222.0.23 () {56 vars in 1180 bytes} [Thu Aug 18 19:28:15 2022] GET /identity/v3/groups/70f4cdfc68f04bca8b5b215dc175403c => generated 226 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:15.381870 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b007803-a5b0-4226-9dff-72679086affa None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:15.422518 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3407bbd1-a32d-47db-9459-0e4a2cef60c4 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:15.457124 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fb2931-1b20-478f-9b48-ca0c45bb6b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:15.457786 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb2931-1b20-478f-9b48-ca0c45bb6b44 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:15.458073 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb2931-1b20-478f-9b48-ca0c45bb6b44 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:15.458343 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb2931-1b20-478f-9b48-ca0c45bb6b44 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:15.473184 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:15.476310 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:15.479208 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b007803-a5b0-4226-9dff-72679086affa None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:15.513224 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3568fe11-8c3c-4953-af2b-0006968ecb32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:15.513853 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568fe11-8c3c-4953-af2b-0006968ecb32 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:15.514131 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568fe11-8c3c-4953-af2b-0006968ecb32 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:15.514403 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568fe11-8c3c-4953-af2b-0006968ecb32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:15.515146 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3568fe11-8c3c-4953-af2b-0006968ecb32 None admin] RBAC: Adding query filter params (group.id=70f4cdfc68f04bca8b5b215dc175403c, role.id=629bead347a8449ebece758b5a7ae23d, scope.project.id=f04621419eb84b00a435d700f145cf48) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:15.515452 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3568fe11-8c3c-4953-af2b-0006968ecb32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:15.516873 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3568fe11-8c3c-4953-af2b-0006968ecb32 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:15.522542 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 233/451] 10.222.0.23 () {56 vars in 1376 bytes} [Thu Aug 18 19:28:15 2022] GET /identity/v3/role_assignments?group.id=70f4cdfc68f04bca8b5b215dc175403c&scope.project.id=f04621419eb84b00a435d700f145cf48&role.id=629bead347a8449ebece758b5a7ae23d => generated 611 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:28:15.523950 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fb2931-1b20-478f-9b48-ca0c45bb6b44 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:15.525385 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fb2931-1b20-478f-9b48-ca0c45bb6b44 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:15.631331 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 219/452] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Aug 18 19:28:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 18 19:28:15.637209 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3568fe11-8c3c-4953-af2b-0006968ecb32 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:15.741734 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3568fe11-8c3c-4953-af2b-0006968ecb32 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:15.776927 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d19f40d-c293-44f9-91ec-488b09f69cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:15.777477 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19f40d-c293-44f9-91ec-488b09f69cc0 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:15.777813 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19f40d-c293-44f9-91ec-488b09f69cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:15.778081 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19f40d-c293-44f9-91ec-488b09f69cc0 None admin] PATH_INFO: `/v3/projects/df56ebe1a05047a7a4d05174a8a4c7f1` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:15.779181 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d19f40d-c293-44f9-91ec-488b09f69cc0 None admin] RBAC: Authorizing `identity:get_project(project_id=df56ebe1a05047a7a4d05174a8a4c7f1)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:15.781133 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d19f40d-c293-44f9-91ec-488b09f69cc0 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:15.782769 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 234/453] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Aug 18 19:28:15 2022] GET /identity/v3/projects/df56ebe1a05047a7a4d05174a8a4c7f1 => generated 344 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:15.788328 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fb2931-1b20-478f-9b48-ca0c45bb6b44 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:15.840424 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:15.889902 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fb2931-1b20-478f-9b48-ca0c45bb6b44 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:15.923548 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05f5129-14d8-40c9-ae62-1a26919f8d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:15.924161 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f5129-14d8-40c9-ae62-1a26919f8d7a None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:15.924440 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f5129-14d8-40c9-ae62-1a26919f8d7a None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:15.924709 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f5129-14d8-40c9-ae62-1a26919f8d7a None admin] PATH_INFO: `/v3/groups/7d0df689d48744fa93e2a493f380a06a` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:15.925826 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05f5129-14d8-40c9-ae62-1a26919f8d7a None admin] RBAC: Authorizing `identity:get_group(group_id=7d0df689d48744fa93e2a493f380a06a)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:15.927259 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05f5129-14d8-40c9-ae62-1a26919f8d7a None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:15.928806 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 220/454] 10.222.0.23 () {56 vars in 1180 bytes} [Thu Aug 18 19:28:15 2022] GET /identity/v3/groups/7d0df689d48744fa93e2a493f380a06a => generated 229 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:15.934768 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d19f40d-c293-44f9-91ec-488b09f69cc0 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:15.962255 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:16.031872 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d19f40d-c293-44f9-91ec-488b09f69cc0 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:16.066365 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998c77a0-28dc-4f8c-b188-457e84e80dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:16.066965 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998c77a0-28dc-4f8c-b188-457e84e80dcb None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:16.067242 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998c77a0-28dc-4f8c-b188-457e84e80dcb None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:16.067512 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998c77a0-28dc-4f8c-b188-457e84e80dcb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:16.068221 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998c77a0-28dc-4f8c-b188-457e84e80dcb None admin] RBAC: Adding query filter params (group.id=7d0df689d48744fa93e2a493f380a06a, role.id=33fe6be3baf44b969c8166af5142e0c7, scope.project.id=df56ebe1a05047a7a4d05174a8a4c7f1) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:16.068526 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998c77a0-28dc-4f8c-b188-457e84e80dcb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:16.069982 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998c77a0-28dc-4f8c-b188-457e84e80dcb None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:16.075689 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 235/455] 10.222.0.23 () {56 vars in 1376 bytes} [Thu Aug 18 19:28:15 2022] GET /identity/v3/role_assignments?group.id=7d0df689d48744fa93e2a493f380a06a&scope.project.id=df56ebe1a05047a7a4d05174a8a4c7f1&role.id=33fe6be3baf44b969c8166af5142e0c7 => generated 611 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:18.513331 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf819007-17d6-434e-8e96-58ca3cf53c57 None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:18.513891 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf819007-17d6-434e-8e96-58ca3cf53c57 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:18.513891 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf819007-17d6-434e-8e96-58ca3cf53c57 None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:18.515508 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 221/456] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:28:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:28:18.521424 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8017a9-0b32-487e-b207-31766d144b84 None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:18.522311 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8017a9-0b32-487e-b207-31766d144b84 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:18.522800 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8017a9-0b32-487e-b207-31766d144b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:18.541476 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-8d8017a9-0b32-487e-b207-31766d144b84 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:28:18.542964 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-8d8017a9-0b32-487e-b207-31766d144b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:28:18.622026 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 236/457] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:28:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:28:18.754676 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a7cd44-c1ab-4b41-a75d-7b09fb68da6c None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:18.754953 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a7cd44-c1ab-4b41-a75d-7b09fb68da6c None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:18.755230 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a7cd44-c1ab-4b41-a75d-7b09fb68da6c None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:18.756912 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 222/458] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:28:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:28:18.762578 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bd4a52-5921-489a-9bd1-5c92554ea698 None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:18.762862 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bd4a52-5921-489a-9bd1-5c92554ea698 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:18.763133 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bd4a52-5921-489a-9bd1-5c92554ea698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:18.781788 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-a9bd4a52-5921-489a-9bd1-5c92554ea698 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:28:18.782875 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-a9bd4a52-5921-489a-9bd1-5c92554ea698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:28:18.799897 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:18.851500 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 237/459] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:28:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:28:18.916501 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32466ec-6126-4896-b6e0-974e509f258f None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:18.916812 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32466ec-6126-4896-b6e0-974e509f258f None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:18.917049 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32466ec-6126-4896-b6e0-974e509f258f None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:18.918663 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 223/460] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:28:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:28:18.927498 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0bd530-1f34-41e8-b7fb-3a4b99f83fe8 None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:18.927498 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0bd530-1f34-41e8-b7fb-3a4b99f83fe8 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:18.927498 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0bd530-1f34-41e8-b7fb-3a4b99f83fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:18.943362 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-df0bd530-1f34-41e8-b7fb-3a4b99f83fe8 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:28:18.944744 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-df0bd530-1f34-41e8-b7fb-3a4b99f83fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:28:18.957497 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32466ec-6126-4896-b6e0-974e509f258f None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:19.015594 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 238/461] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:28:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:28:19.080190 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32466ec-6126-4896-b6e0-974e509f258f None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:19.099639 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:19.117019 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546dfefc-5145-4855-bd18-bf27f7c4bddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:19.117738 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546dfefc-5145-4855-bd18-bf27f7c4bddf None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:19.118020 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546dfefc-5145-4855-bd18-bf27f7c4bddf None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:19.121745 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546dfefc-5145-4855-bd18-bf27f7c4bddf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:19.128660 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546dfefc-5145-4855-bd18-bf27f7c4bddf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:19.130149 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546dfefc-5145-4855-bd18-bf27f7c4bddf None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:19.145114 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application [None req-546dfefc-5145-4855-bd18-bf27f7c4bddf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:28:19.145114 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:19.145114 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:19.145114 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:19.145114 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:19.145114 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:19.145114 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:19.145114 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:19.145114 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:19.145114 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:19.145114 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:19.145114 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:19.145114 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 19:28:19.145114 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 19:28:19.145114 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 19:28:19.145114 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 19:28:19.146083 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:19.146083 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:19.146083 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:19.146083 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:19.146083 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:19.146083 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:19.146083 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:19.146083 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:19.146083 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:19.146083 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:19.146083 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:19.146083 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:19.146083 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:19.146083 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:19.146083 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:19.146083 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:19.146083 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 19:28:19.146945 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 19:28:19.146945 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:28:19.146945 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:28:19.146945 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 224/462] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Aug 18 19:28:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 19:28:19.155558 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0bd530-1f34-41e8-b7fb-3a4b99f83fe8 None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:19.199006 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546dfefc-5145-4855-bd18-bf27f7c4bddf None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:19.241994 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:19.263551 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0bd530-1f34-41e8-b7fb-3a4b99f83fe8 None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:19.303937 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546dfefc-5145-4855-bd18-bf27f7c4bddf None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:19.307664 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8cf868-b3cf-4cf4-9193-15aa8d17caa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:19.308282 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8cf868-b3cf-4cf4-9193-15aa8d17caa6 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:19.308570 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8cf868-b3cf-4cf4-9193-15aa8d17caa6 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:19.308870 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8cf868-b3cf-4cf4-9193-15aa8d17caa6 None admin] PATH_INFO: `/v3/domains` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:19.309487 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8cf868-b3cf-4cf4-9193-15aa8d17caa6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:19.309827 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8cf868-b3cf-4cf4-9193-15aa8d17caa6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:19.311631 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8cf868-b3cf-4cf4-9193-15aa8d17caa6 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:19.335692 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 239/463] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Aug 18 19:28:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:19.335692 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5473617-f938-4100-bfff-0a9e748a089a None None] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:19.335692 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5473617-f938-4100-bfff-0a9e748a089a None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:19.335692 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5473617-f938-4100-bfff-0a9e748a089a None None] PATH_INFO: `/` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:19.335692 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 240/464] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:28:19 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:28:19.339729 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5473617-f938-4100-bfff-0a9e748a089a None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:19.344595 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b45ab9-864d-45c3-bea2-9bd199547368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:19.345219 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b45ab9-864d-45c3-bea2-9bd199547368 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:19.345495 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b45ab9-864d-45c3-bea2-9bd199547368 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:19.345795 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b45ab9-864d-45c3-bea2-9bd199547368 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:19.356534 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b45ab9-864d-45c3-bea2-9bd199547368 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:19.358025 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b45ab9-864d-45c3-bea2-9bd199547368 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:19.371724 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application [None req-d6b45ab9-864d-45c3-bea2-9bd199547368 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:28:19.371724 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:19.371724 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:19.371724 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:19.371724 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:19.371724 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:19.371724 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:19.371724 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:19.371724 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:19.371724 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:19.371724 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:19.371724 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:19.371724 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 19:28:19.371724 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 19:28:19.371724 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 19:28:19.371724 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 19:28:19.372876 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:19.372876 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:19.372876 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:19.372876 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:19.372876 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:19.372876 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:19.372876 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:19.372876 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:19.372876 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:19.372876 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:19.372876 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:19.372876 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:19.372876 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:19.372876 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:19.372876 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:19.372876 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:19.372876 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 19:28:19.373941 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 19:28:19.373941 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:28:19.373941 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:28:19.373941 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 225/465] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Aug 18 19:28:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:28:19.374288 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558100a1-45bf-4bf7-9c6f-61871bf8586a None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:19.374569 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558100a1-45bf-4bf7-9c6f-61871bf8586a None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:19.374836 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558100a1-45bf-4bf7-9c6f-61871bf8586a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:19.392519 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-558100a1-45bf-4bf7-9c6f-61871bf8586a None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:28:19.393729 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-558100a1-45bf-4bf7-9c6f-61871bf8586a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:28:19.410773 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:19.445843 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5473617-f938-4100-bfff-0a9e748a089a None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:19.458286 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 226/466] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:28:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:28:19.459114 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558100a1-45bf-4bf7-9c6f-61871bf8586a None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:19.480140 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58d6323-0599-435f-8103-1534fcaa99c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:19.481147 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d6323-0599-435f-8103-1534fcaa99c5 None admin] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:19.481428 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d6323-0599-435f-8103-1534fcaa99c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:19.481724 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d6323-0599-435f-8103-1534fcaa99c5 None admin] PATH_INFO: `/v3/users` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:19.482364 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58d6323-0599-435f-8103-1534fcaa99c5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:19.484474 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58d6323-0599-435f-8103-1534fcaa99c5 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:19.569103 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:19.570018 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558100a1-45bf-4bf7-9c6f-61871bf8586a None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:19.583437 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 241/467] 10.222.0.23 () {60 vars in 1132 bytes} [Thu Aug 18 19:28:19 2022] POST /identity/v3/users => generated 246 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 19:28:19.583437 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58d6323-0599-435f-8103-1534fcaa99c5 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:19.619859 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d4ece7-b02a-4738-8f45-e590a490984b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:19.619859 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d4ece7-b02a-4738-8f45-e590a490984b None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:19.619859 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d4ece7-b02a-4738-8f45-e590a490984b None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:19.619859 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d4ece7-b02a-4738-8f45-e590a490984b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:19.634889 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d4ece7-b02a-4738-8f45-e590a490984b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:19.638920 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d4ece7-b02a-4738-8f45-e590a490984b None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:19.660295 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application [None req-13d4ece7-b02a-4738-8f45-e590a490984b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:28:19.660295 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:19.660295 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:19.660295 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:19.660295 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:19.660295 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:19.660295 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:19.660295 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:19.660295 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:19.660295 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:19.660295 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:19.660295 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:19.660295 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 19:28:19.660295 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 19:28:19.660295 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 19:28:19.660295 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 19:28:19.661322 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:19.661322 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:19.661322 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:19.661322 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:19.661322 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:19.661322 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:19.661322 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:19.661322 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:19.661322 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:19.661322 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:19.661322 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:19.661322 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:19.661322 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:19.661322 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:19.661322 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:19.661322 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:19.661322 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 19:28:19.662225 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 19:28:19.662225 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:28:19.662225 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:28:19.662225 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 227/468] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Aug 18 19:28:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:28:19.668361 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d4ece7-b02a-4738-8f45-e590a490984b None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:19.672646 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:19.719938 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58d6323-0599-435f-8103-1534fcaa99c5 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:19.760200 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c86c517-afd8-4873-b39e-ceb9a917098b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:19.761284 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c86c517-afd8-4873-b39e-ceb9a917098b None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:19.761631 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c86c517-afd8-4873-b39e-ceb9a917098b None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:19.762010 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c86c517-afd8-4873-b39e-ceb9a917098b None admin] PATH_INFO: `/v3/domains` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:19.762780 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c86c517-afd8-4873-b39e-ceb9a917098b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:19.763181 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c86c517-afd8-4873-b39e-ceb9a917098b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:19.765370 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c86c517-afd8-4873-b39e-ceb9a917098b None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:19.780701 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 242/469] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Aug 18 19:28:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:19.786574 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c86c517-afd8-4873-b39e-ceb9a917098b None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:19.797052 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d4ece7-b02a-4738-8f45-e590a490984b None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:19.835307 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e8e998-70ee-4d37-b9dc-ba800ba2599a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:19.835910 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e8e998-70ee-4d37-b9dc-ba800ba2599a None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:19.836189 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e8e998-70ee-4d37-b9dc-ba800ba2599a None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:19.836459 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e8e998-70ee-4d37-b9dc-ba800ba2599a None admin] PATH_INFO: `/v3/domains` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:19.837388 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e8e998-70ee-4d37-b9dc-ba800ba2599a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:19.837778 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e8e998-70ee-4d37-b9dc-ba800ba2599a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:19.839147 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e8e998-70ee-4d37-b9dc-ba800ba2599a None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:19.852394 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 228/470] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Aug 18 19:28:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:28:19.857720 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e8e998-70ee-4d37-b9dc-ba800ba2599a None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:19.860703 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:19.909367 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c86c517-afd8-4873-b39e-ceb9a917098b None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:19.927171 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:19.946494 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaa2697-49f4-408d-8450-c29125b2ea4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:19.947102 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaa2697-49f4-408d-8450-c29125b2ea4d None admin] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:19.947377 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaa2697-49f4-408d-8450-c29125b2ea4d None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:19.947655 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaa2697-49f4-408d-8450-c29125b2ea4d None admin] PATH_INFO: `/v3/users` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:19.948277 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaa2697-49f4-408d-8450-c29125b2ea4d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:19.949948 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaa2697-49f4-408d-8450-c29125b2ea4d None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:19.967760 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e8e998-70ee-4d37-b9dc-ba800ba2599a None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:20.002317 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06ff46e-e294-491d-ae6c-17463c352eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:20.002935 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ff46e-e294-491d-ae6c-17463c352eff None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:20.003212 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ff46e-e294-491d-ae6c-17463c352eff None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:20.003479 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ff46e-e294-491d-ae6c-17463c352eff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:20.013766 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06ff46e-e294-491d-ae6c-17463c352eff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:20.015234 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06ff46e-e294-491d-ae6c-17463c352eff None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:20.026659 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 243/471] 10.222.0.23 () {60 vars in 1132 bytes} [Thu Aug 18 19:28:19 2022] POST /identity/v3/users => generated 248 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 19:28:20.027527 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaa2697-49f4-408d-8450-c29125b2ea4d None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:20.033528 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application [None req-e06ff46e-e294-491d-ae6c-17463c352eff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:28:20.033528 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:20.033528 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:20.033528 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:20.033528 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:20.033528 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:20.033528 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:20.033528 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:20.033528 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:20.033528 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:20.033528 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:20.033528 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:20.033528 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 19:28:20.033528 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 19:28:20.033528 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 19:28:20.033528 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 19:28:20.034553 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:20.034553 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:20.034553 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:20.034553 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:20.034553 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:20.034553 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:20.034553 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:20.034553 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:20.034553 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:20.034553 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:20.034553 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:20.034553 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:20.034553 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:20.034553 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:20.034553 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:20.034553 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:20.034553 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 19:28:20.035409 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 19:28:20.035409 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:28:20.035409 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:28:20.036035 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 229/472] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Aug 18 19:28:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:28:20.041865 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06ff46e-e294-491d-ae6c-17463c352eff None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:20.172720 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaa2697-49f4-408d-8450-c29125b2ea4d None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:20.188544 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:20.193872 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06ff46e-e294-491d-ae6c-17463c352eff None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:20.210915 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b44ffa-29ac-4960-91ef-c9e1ac978afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:20.211485 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b44ffa-29ac-4960-91ef-c9e1ac978afb None admin] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:20.212030 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b44ffa-29ac-4960-91ef-c9e1ac978afb None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:20.212304 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b44ffa-29ac-4960-91ef-c9e1ac978afb None admin] PATH_INFO: `/v3/users` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:20.213615 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:20.213771 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b44ffa-29ac-4960-91ef-c9e1ac978afb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:20.216160 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b44ffa-29ac-4960-91ef-c9e1ac978afb None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:20.234849 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc51c5db-6c43-4018-aed4-ae21061f1899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:20.235561 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc51c5db-6c43-4018-aed4-ae21061f1899 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:20.235841 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc51c5db-6c43-4018-aed4-ae21061f1899 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:20.236113 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc51c5db-6c43-4018-aed4-ae21061f1899 None admin] PATH_INFO: `/v3/domains` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:20.236751 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc51c5db-6c43-4018-aed4-ae21061f1899 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:20.237054 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc51c5db-6c43-4018-aed4-ae21061f1899 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:20.238494 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc51c5db-6c43-4018-aed4-ae21061f1899 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:20.253397 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 230/473] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Aug 18 19:28:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:28:20.259056 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc51c5db-6c43-4018-aed4-ae21061f1899 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:20.289429 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 244/474] 10.222.0.23 () {60 vars in 1132 bytes} [Thu Aug 18 19:28:20 2022] POST /identity/v3/users => generated 248 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 19:28:20.387691 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc51c5db-6c43-4018-aed4-ae21061f1899 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:20.428439 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a8c4bd-c3fe-47ce-bf1b-ee23660d6cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:20.428981 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a8c4bd-c3fe-47ce-bf1b-ee23660d6cf2 None admin] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:20.429262 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a8c4bd-c3fe-47ce-bf1b-ee23660d6cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:20.429534 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a8c4bd-c3fe-47ce-bf1b-ee23660d6cf2 None admin] PATH_INFO: `/v3/users` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:20.430330 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a8c4bd-c3fe-47ce-bf1b-ee23660d6cf2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:20.431854 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a8c4bd-c3fe-47ce-bf1b-ee23660d6cf2 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:20.495161 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 231/475] 10.222.0.23 () {60 vars in 1132 bytes} [Thu Aug 18 19:28:20 2022] POST /identity/v3/users => generated 249 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 19:28:21.859043 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6054e1e3-04d4-434e-90e6-c72d95806ee0 None None] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:21.859994 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6054e1e3-04d4-434e-90e6-c72d95806ee0 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:21.860494 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6054e1e3-04d4-434e-90e6-c72d95806ee0 None None] PATH_INFO: `/` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:21.862284 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 245/476] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:28:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:28:21.867792 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519efbbe-c904-47fb-a588-d28d7589b2dd None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:21.868592 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519efbbe-c904-47fb-a588-d28d7589b2dd None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:21.869060 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519efbbe-c904-47fb-a588-d28d7589b2dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:21.887601 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-519efbbe-c904-47fb-a588-d28d7589b2dd None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:28:21.889114 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-519efbbe-c904-47fb-a588-d28d7589b2dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:28:21.917735 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:21.962507 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 232/477] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:28:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:28:22.298122 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6054e1e3-04d4-434e-90e6-c72d95806ee0 None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:22.398466 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18286e2c-9b33-4e96-811d-9cdb71bd1b1d None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:22.399217 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18286e2c-9b33-4e96-811d-9cdb71bd1b1d None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:22.399697 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18286e2c-9b33-4e96-811d-9cdb71bd1b1d None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:22.401475 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 233/478] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:28:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 19:28:22.407147 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6054e1e3-04d4-434e-90e6-c72d95806ee0 None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:22.407398 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9340775-45bc-456b-bf2e-fd95f03752c9 None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:22.407898 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9340775-45bc-456b-bf2e-fd95f03752c9 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:22.408384 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9340775-45bc-456b-bf2e-fd95f03752c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:22.427133 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-d9340775-45bc-456b-bf2e-fd95f03752c9 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:28:22.428753 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-d9340775-45bc-456b-bf2e-fd95f03752c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:28:22.447675 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1c8c50-30e0-4f7f-9b70-46e53155782e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:22.448306 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1c8c50-30e0-4f7f-9b70-46e53155782e None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:22.448589 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1c8c50-30e0-4f7f-9b70-46e53155782e None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:22.448861 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1c8c50-30e0-4f7f-9b70-46e53155782e None admin] PATH_INFO: `/v3/roles/service` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:22.466663 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1c8c50-30e0-4f7f-9b70-46e53155782e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:28:22.472175 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application [None req-5f1c8c50-30e0-4f7f-9b70-46e53155782e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 19:28:22.472175 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:22.472175 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:22.472175 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:22.472175 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:22.472175 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:22.472175 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:22.472175 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:22.472175 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:22.472175 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:22.472175 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:22.472175 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:22.472175 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:28:22.472175 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:28:22.472175 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:28:22.472175 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:28:22.473058 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:28:22.473058 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:28:22.473058 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:28:22.473058 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:28:22.473058 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:22.473058 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:22.473058 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:22.473058 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:22.473058 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:22.473058 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:22.473058 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:22.473058 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:22.473058 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:22.473058 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:22.473058 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:22.473058 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:22.473898 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:22.473898 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:22.473898 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:22.473898 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:22.473898 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:28:22.473898 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:28:22.473898 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:28:22.473898 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:28:22.473898 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:28:22.473898 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:28:22.473898 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 19:28:22.473898 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:28:22.473898 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 246/479] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Aug 18 19:28:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:28:22.482673 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1c8c50-30e0-4f7f-9b70-46e53155782e None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:22.518460 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:22.531683 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 234/480] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:28:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 18 19:28:22.597050 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1c8c50-30e0-4f7f-9b70-46e53155782e None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:22.632531 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710797a8-8647-4a77-8a0e-e33c3bc09482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:22.633484 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710797a8-8647-4a77-8a0e-e33c3bc09482 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:22.634153 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710797a8-8647-4a77-8a0e-e33c3bc09482 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:22.634628 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710797a8-8647-4a77-8a0e-e33c3bc09482 None admin] PATH_INFO: `/v3/roles` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:22.635510 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710797a8-8647-4a77-8a0e-e33c3bc09482 None admin] RBAC: Adding query filter params (name=service) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:22.636029 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710797a8-8647-4a77-8a0e-e33c3bc09482 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:22.637616 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710797a8-8647-4a77-8a0e-e33c3bc09482 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:22.647103 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 247/481] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Aug 18 19:28:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:22.654911 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9340775-45bc-456b-bf2e-fd95f03752c9 None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:22.663749 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea0b3b-9c23-4bd4-9ae2-4c6d06e80986 None None] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:22.664045 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea0b3b-9c23-4bd4-9ae2-4c6d06e80986 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:22.664324 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea0b3b-9c23-4bd4-9ae2-4c6d06e80986 None None] PATH_INFO: `/` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:22.669472 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 248/482] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:28:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 19:28:22.670661 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847c2836-6a80-44b9-90a8-8e326fbbb52c None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:22.670943 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847c2836-6a80-44b9-90a8-8e326fbbb52c None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:22.671220 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847c2836-6a80-44b9-90a8-8e326fbbb52c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:22.690766 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-847c2836-6a80-44b9-90a8-8e326fbbb52c None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:28:22.691961 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-847c2836-6a80-44b9-90a8-8e326fbbb52c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:28:22.761397 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:22.771403 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 249/483] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:28:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:28:22.779820 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9340775-45bc-456b-bf2e-fd95f03752c9 None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:22.818119 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095bda2c-cd7a-4412-bea2-e15d4f865def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:22.819141 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095bda2c-cd7a-4412-bea2-e15d4f865def None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:22.819662 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095bda2c-cd7a-4412-bea2-e15d4f865def None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:22.820124 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095bda2c-cd7a-4412-bea2-e15d4f865def None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:22.831488 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095bda2c-cd7a-4412-bea2-e15d4f865def None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:22.833197 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095bda2c-cd7a-4412-bea2-e15d4f865def None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:22.848682 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application [None req-095bda2c-cd7a-4412-bea2-e15d4f865def None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:28:22.848682 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:22.848682 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:22.848682 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:22.848682 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:22.848682 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:22.848682 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:22.848682 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:22.848682 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:22.848682 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:22.848682 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:22.848682 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:22.848682 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 19:28:22.848682 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 19:28:22.848682 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 19:28:22.848682 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 19:28:22.849558 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:22.849558 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:22.849558 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:22.849558 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:22.849558 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:22.849558 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:22.849558 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:22.849558 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:22.849558 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:22.849558 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:22.849558 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:22.849558 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:22.849558 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:22.849558 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:22.849558 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:22.849558 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:22.849558 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 19:28:22.850442 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 19:28:22.850442 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:28:22.850442 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:28:22.852421 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 235/484] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Aug 18 19:28:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:28:22.858309 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847c2836-6a80-44b9-90a8-8e326fbbb52c None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:22.861970 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095bda2c-cd7a-4412-bea2-e15d4f865def None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:22.884634 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:22.966003 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095bda2c-cd7a-4412-bea2-e15d4f865def None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:22.966526 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847c2836-6a80-44b9-90a8-8e326fbbb52c None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:23.000026 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3900c3-b5b6-461a-92a5-a2e32dc37b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:23.000598 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63638229-2ba6-444a-a1c6-30356b3106a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:23.000738 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3900c3-b5b6-461a-92a5-a2e32dc37b1e None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:23.000936 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3900c3-b5b6-461a-92a5-a2e32dc37b1e None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:23.001167 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3900c3-b5b6-461a-92a5-a2e32dc37b1e None admin] PATH_INFO: `/v3/roles/service` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:23.001263 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63638229-2ba6-444a-a1c6-30356b3106a5 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:23.001455 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63638229-2ba6-444a-a1c6-30356b3106a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:23.001754 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63638229-2ba6-444a-a1c6-30356b3106a5 None admin] PATH_INFO: `/v3/domains` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:23.002387 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63638229-2ba6-444a-a1c6-30356b3106a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:23.002691 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63638229-2ba6-444a-a1c6-30356b3106a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:23.004058 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63638229-2ba6-444a-a1c6-30356b3106a5 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:23.011600 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3900c3-b5b6-461a-92a5-a2e32dc37b1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:28:23.015505 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 250/485] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Aug 18 19:28:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:23.016479 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df35200e-64b3-4068-ae85-ed44eb061939 None None] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:23.016764 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df35200e-64b3-4068-ae85-ed44eb061939 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:23.017037 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df35200e-64b3-4068-ae85-ed44eb061939 None None] PATH_INFO: `/` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:23.018252 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 251/486] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:28:23 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:28:23.021243 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application [None req-0d3900c3-b5b6-461a-92a5-a2e32dc37b1e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 19:28:23.021243 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:23.021243 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:23.021243 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:23.021243 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:23.021243 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:23.021243 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:23.021243 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:23.021243 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:23.021243 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:23.021243 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:23.021243 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:23.021243 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:28:23.021243 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:28:23.021243 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:28:23.021243 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:28:23.022261 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:28:23.022261 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:28:23.022261 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:28:23.022261 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:28:23.022261 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:23.022261 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:23.022261 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:23.022261 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:23.022261 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:23.022261 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:23.022261 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:23.022261 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:23.022261 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:23.022261 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:23.022261 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:23.022261 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:23.023366 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:23.023366 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:23.023366 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:23.023366 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:23.023366 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:28:23.023366 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:28:23.023366 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:28:23.023366 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:28:23.023366 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:28:23.023366 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:28:23.023366 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 19:28:23.023366 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:28:23.023366 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 236/487] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Aug 18 19:28:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:28:23.024023 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df35200e-64b3-4068-ae85-ed44eb061939 None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:23.024106 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f061a2e1-3956-41df-815e-83c7aa25f653 None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:23.024106 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f061a2e1-3956-41df-815e-83c7aa25f653 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:23.024613 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f061a2e1-3956-41df-815e-83c7aa25f653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:23.032979 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:23.044119 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-f061a2e1-3956-41df-815e-83c7aa25f653 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:28:23.047472 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-f061a2e1-3956-41df-815e-83c7aa25f653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:28:23.120583 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:23.125862 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 237/488] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:28:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:28:23.127008 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f061a2e1-3956-41df-815e-83c7aa25f653 None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:23.147469 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df35200e-64b3-4068-ae85-ed44eb061939 None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:23.184020 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cc1069-4e41-4132-a2f8-d0dffc581f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:23.184642 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cc1069-4e41-4132-a2f8-d0dffc581f2e None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:23.184923 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cc1069-4e41-4132-a2f8-d0dffc581f2e None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:23.185195 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cc1069-4e41-4132-a2f8-d0dffc581f2e None admin] PATH_INFO: `/v3/users/nova` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:23.193291 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cc1069-4e41-4132-a2f8-d0dffc581f2e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:23.194755 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cc1069-4e41-4132-a2f8-d0dffc581f2e None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:23.207202 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application [None req-04cc1069-4e41-4132-a2f8-d0dffc581f2e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 18 19:28:23.207202 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:23.207202 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:23.207202 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:23.207202 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:23.207202 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:23.207202 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:23.207202 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:23.207202 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:23.207202 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:23.207202 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:23.207202 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:23.207202 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 19:28:23.207202 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 19:28:23.207202 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 19:28:23.207202 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 19:28:23.208154 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:23.208154 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:23.208154 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 19:28:23.208154 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 19:28:23.208154 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 19:28:23.208154 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 19:28:23.208154 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:23.208154 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:23.208154 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:23.208154 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:23.208154 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:23.208154 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:23.208154 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:23.208154 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:23.208154 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:23.208154 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:23.208154 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:23.208154 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:23.214274 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:23.214274 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:23.214274 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 19:28:23.214274 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 19:28:23.214274 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 19:28:23.214274 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 19:28:23.214274 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 19:28:23.214274 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 19:28:23.214274 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 18 19:28:23.214274 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:28:23.214274 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 252/489] 10.222.0.23 () {56 vars in 1093 bytes} [Thu Aug 18 19:28:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:28:23.214274 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cc1069-4e41-4132-a2f8-d0dffc581f2e None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:23.241593 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f061a2e1-3956-41df-815e-83c7aa25f653 None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:23.278685 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f509880-3943-475c-9194-1c56f132a09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:23.279285 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f509880-3943-475c-9194-1c56f132a09e None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:23.280103 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f509880-3943-475c-9194-1c56f132a09e None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:23.280375 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f509880-3943-475c-9194-1c56f132a09e None admin] PATH_INFO: `/v3/roles` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:23.281026 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f509880-3943-475c-9194-1c56f132a09e None admin] RBAC: Adding query filter params (name=service) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:23.281325 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f509880-3943-475c-9194-1c56f132a09e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:23.282972 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f509880-3943-475c-9194-1c56f132a09e None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:23.284172 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:23.298391 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 238/490] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Aug 18 19:28:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:23.298391 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f509880-3943-475c-9194-1c56f132a09e None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:23.319275 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cc1069-4e41-4132-a2f8-d0dffc581f2e None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:23.353921 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c8cfd6-5efd-40d2-8fd1-dbda4f53ed4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:23.354715 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c8cfd6-5efd-40d2-8fd1-dbda4f53ed4b None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:23.355049 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c8cfd6-5efd-40d2-8fd1-dbda4f53ed4b None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:23.355326 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c8cfd6-5efd-40d2-8fd1-dbda4f53ed4b None admin] PATH_INFO: `/v3/roles/service` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:23.367098 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c8cfd6-5efd-40d2-8fd1-dbda4f53ed4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:28:23.373001 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application [None req-25c8cfd6-5efd-40d2-8fd1-dbda4f53ed4b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 19:28:23.373001 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:23.373001 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:23.373001 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:23.373001 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:23.373001 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:23.373001 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:23.373001 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:23.373001 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:23.373001 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:23.373001 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:23.373001 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:23.373001 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:28:23.373001 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:28:23.373001 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:28:23.373001 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:28:23.380892 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:28:23.380892 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:28:23.380892 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:28:23.380892 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:28:23.380892 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:23.380892 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:23.380892 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:23.380892 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:23.380892 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:23.380892 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:23.380892 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:23.380892 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:23.380892 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:23.380892 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:23.380892 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:23.380892 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:23.381744 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:23.381744 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:23.381744 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:23.381744 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:23.381744 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:28:23.381744 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:28:23.381744 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:28:23.381744 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:28:23.381744 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:28:23.381744 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:28:23.381744 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 19:28:23.381744 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:28:23.381744 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 253/491] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Aug 18 19:28:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:28:23.381744 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c8cfd6-5efd-40d2-8fd1-dbda4f53ed4b None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:23.382568 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:23.407025 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f509880-3943-475c-9194-1c56f132a09e None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:23.445392 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce359eb3-b38d-4475-896b-199a3c2b83f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:23.446028 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce359eb3-b38d-4475-896b-199a3c2b83f4 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:23.446308 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce359eb3-b38d-4475-896b-199a3c2b83f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:23.446580 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce359eb3-b38d-4475-896b-199a3c2b83f4 None admin] PATH_INFO: `/v3/users` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:23.447297 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce359eb3-b38d-4475-896b-199a3c2b83f4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:23.447601 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce359eb3-b38d-4475-896b-199a3c2b83f4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:23.449040 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce359eb3-b38d-4475-896b-199a3c2b83f4 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:23.487713 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c8cfd6-5efd-40d2-8fd1-dbda4f53ed4b None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:23.488756 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 239/492] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Aug 18 19:28:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:23.489631 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce359eb3-b38d-4475-896b-199a3c2b83f4 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:23.525419 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288ba5d7-8ea8-48d2-8643-9c827a70b859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:23.526208 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ba5d7-8ea8-48d2-8643-9c827a70b859 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:23.526489 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ba5d7-8ea8-48d2-8643-9c827a70b859 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:23.526764 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ba5d7-8ea8-48d2-8643-9c827a70b859 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:23.538200 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288ba5d7-8ea8-48d2-8643-9c827a70b859 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:23.539669 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288ba5d7-8ea8-48d2-8643-9c827a70b859 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:23.543891 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:23.555688 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application [None req-288ba5d7-8ea8-48d2-8643-9c827a70b859 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:28:23.555688 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:23.555688 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:23.555688 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:23.555688 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:23.555688 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:23.555688 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:23.555688 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:23.555688 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:23.555688 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:23.555688 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:23.555688 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:23.555688 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 19:28:23.555688 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 19:28:23.555688 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 19:28:23.555688 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 19:28:23.556577 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:23.556577 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:23.556577 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:23.556577 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:23.556577 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:23.556577 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:23.556577 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:23.556577 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:23.556577 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:23.556577 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:23.556577 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:23.556577 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:23.556577 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:23.556577 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:23.556577 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:23.556577 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:23.556577 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 19:28:23.557437 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 19:28:23.557437 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:28:23.557437 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:28:23.557437 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 254/493] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Aug 18 19:28:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:28:23.557676 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288ba5d7-8ea8-48d2-8643-9c827a70b859 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:23.593368 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce359eb3-b38d-4475-896b-199a3c2b83f4 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:23.616193 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:23.627447 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74d4de4-89ad-46d2-b289-8878ca462ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:23.627985 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74d4de4-89ad-46d2-b289-8878ca462ad6 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:23.628266 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74d4de4-89ad-46d2-b289-8878ca462ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:23.628539 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74d4de4-89ad-46d2-b289-8878ca462ad6 None admin] PATH_INFO: `/v3/roles` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:23.629226 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74d4de4-89ad-46d2-b289-8878ca462ad6 None admin] RBAC: Adding query filter params (name=service) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:23.629527 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74d4de4-89ad-46d2-b289-8878ca462ad6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:23.630941 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74d4de4-89ad-46d2-b289-8878ca462ad6 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:23.639535 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 240/494] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Aug 18 19:28:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:23.640330 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74d4de4-89ad-46d2-b289-8878ca462ad6 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:23.667341 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288ba5d7-8ea8-48d2-8643-9c827a70b859 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:23.700817 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f83866-b425-40cc-b1a3-d0064535e8d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:23.702163 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f83866-b425-40cc-b1a3-d0064535e8d7 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:23.702437 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f83866-b425-40cc-b1a3-d0064535e8d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:23.702703 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f83866-b425-40cc-b1a3-d0064535e8d7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:23.712615 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f83866-b425-40cc-b1a3-d0064535e8d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:28:23.718290 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application [None req-40f83866-b425-40cc-b1a3-d0064535e8d7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 19:28:23.718290 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:23.718290 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:23.718290 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:23.718290 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:23.718290 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:23.718290 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:23.718290 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:23.718290 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:23.718290 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:23.718290 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:23.718290 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:23.718290 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:28:23.718290 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:28:23.718290 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:28:23.718290 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:28:23.719167 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:28:23.719167 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:28:23.719167 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:28:23.719167 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:28:23.719167 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:23.719167 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:23.719167 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:23.719167 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:23.719167 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:23.719167 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:23.719167 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:23.719167 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:23.719167 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:23.719167 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:23.719167 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:23.719167 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:23.719985 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:23.719985 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:23.719985 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:23.719985 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:23.719985 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:28:23.719985 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:28:23.719985 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:28:23.719985 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:28:23.719985 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:28:23.719985 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:28:23.719985 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 19:28:23.719985 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:28:23.719985 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 255/495] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Aug 18 19:28:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:28:23.720643 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f83866-b425-40cc-b1a3-d0064535e8d7 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:23.741198 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74d4de4-89ad-46d2-b289-8878ca462ad6 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:23.756829 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:23.774636 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc220baf-e490-4a06-8fbc-35cf20ac61e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:23.775245 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc220baf-e490-4a06-8fbc-35cf20ac61e6 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:23.775521 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc220baf-e490-4a06-8fbc-35cf20ac61e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:23.775796 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc220baf-e490-4a06-8fbc-35cf20ac61e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:23.817401 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f83866-b425-40cc-b1a3-d0064535e8d7 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:23.831121 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:23.843452 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc220baf-e490-4a06-8fbc-35cf20ac61e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:23.845023 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc220baf-e490-4a06-8fbc-35cf20ac61e6 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:23.850790 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8c1eb3-e69b-4145-b424-cb794e08534c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:23.851384 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8c1eb3-e69b-4145-b424-cb794e08534c None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:23.851656 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8c1eb3-e69b-4145-b424-cb794e08534c None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:23.851921 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8c1eb3-e69b-4145-b424-cb794e08534c None admin] PATH_INFO: `/v3/domains` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:23.852542 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8c1eb3-e69b-4145-b424-cb794e08534c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:23.852836 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8c1eb3-e69b-4145-b424-cb794e08534c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:23.854218 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8c1eb3-e69b-4145-b424-cb794e08534c None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:23.866197 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 256/496] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Aug 18 19:28:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:23.866975 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8c1eb3-e69b-4145-b424-cb794e08534c None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:23.941989 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 241/497] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Aug 18 19:28:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 19:28:23.942819 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc220baf-e490-4a06-8fbc-35cf20ac61e6 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:23.961685 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:23.968442 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8c1eb3-e69b-4145-b424-cb794e08534c None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:24.002211 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a43794b-6ecf-4b75-84af-bad15c188689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:24.002835 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a43794b-6ecf-4b75-84af-bad15c188689 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:24.003112 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a43794b-6ecf-4b75-84af-bad15c188689 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:24.003389 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a43794b-6ecf-4b75-84af-bad15c188689 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:24.013551 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a43794b-6ecf-4b75-84af-bad15c188689 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:24.016296 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a43794b-6ecf-4b75-84af-bad15c188689 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:24.033474 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application [None req-4a43794b-6ecf-4b75-84af-bad15c188689 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:28:24.033474 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:24.033474 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:24.033474 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:24.033474 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:24.033474 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:24.033474 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:24.033474 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:24.033474 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:24.033474 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:24.033474 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:24.033474 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:24.033474 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 19:28:24.033474 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 19:28:24.033474 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 19:28:24.033474 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 19:28:24.034459 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:24.034459 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:24.034459 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:24.034459 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:24.034459 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:24.034459 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:24.034459 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:24.034459 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:24.034459 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:24.034459 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:24.034459 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:24.034459 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:24.034459 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:24.034459 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:24.034459 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:24.034459 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:24.034459 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 19:28:24.035330 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 19:28:24.035330 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:28:24.035330 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:28:24.035330 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 257/498] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Aug 18 19:28:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:28:24.035542 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a43794b-6ecf-4b75-84af-bad15c188689 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:24.045987 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc220baf-e490-4a06-8fbc-35cf20ac61e6 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:24.064330 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:24.080760 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e3fa80-0f25-4a11-8d70-96a4815b09c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:24.081363 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e3fa80-0f25-4a11-8d70-96a4815b09c2 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:24.081639 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e3fa80-0f25-4a11-8d70-96a4815b09c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:24.081939 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e3fa80-0f25-4a11-8d70-96a4815b09c2 None admin] PATH_INFO: `/v3/roles` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:24.091113 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e3fa80-0f25-4a11-8d70-96a4815b09c2 None admin] RBAC: Adding query filter params (name=service) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:24.091113 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e3fa80-0f25-4a11-8d70-96a4815b09c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:24.091113 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e3fa80-0f25-4a11-8d70-96a4815b09c2 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:24.092942 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 242/499] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Aug 18 19:28:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:24.093822 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e3fa80-0f25-4a11-8d70-96a4815b09c2 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:24.140423 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a43794b-6ecf-4b75-84af-bad15c188689 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:24.170813 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:24.174619 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4815832c-85fd-43eb-b3d5-ca17c8bee6bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:24.175238 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4815832c-85fd-43eb-b3d5-ca17c8bee6bf None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:24.175513 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4815832c-85fd-43eb-b3d5-ca17c8bee6bf None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:24.175782 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4815832c-85fd-43eb-b3d5-ca17c8bee6bf None admin] PATH_INFO: `/v3/users/glance` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:24.183037 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4815832c-85fd-43eb-b3d5-ca17c8bee6bf None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:24.184481 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4815832c-85fd-43eb-b3d5-ca17c8bee6bf None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:24.192142 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e3fa80-0f25-4a11-8d70-96a4815b09c2 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:24.195727 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application [None req-4815832c-85fd-43eb-b3d5-ca17c8bee6bf None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 18 19:28:24.195727 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:24.195727 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:24.195727 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:24.195727 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:24.195727 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:24.195727 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:24.195727 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:24.195727 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:24.195727 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:24.195727 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:24.195727 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:24.195727 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 19:28:24.195727 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 19:28:24.195727 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 19:28:24.195727 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 19:28:24.196741 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:24.196741 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:24.196741 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 19:28:24.196741 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 19:28:24.196741 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 19:28:24.196741 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 19:28:24.196741 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:24.196741 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:24.196741 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:24.196741 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:24.196741 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:24.196741 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:24.196741 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:24.196741 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:24.196741 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:24.196741 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:24.196741 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:24.196741 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:24.197622 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:24.197622 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:24.197622 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 19:28:24.197622 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 19:28:24.197622 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 19:28:24.197622 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 19:28:24.197622 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 19:28:24.197622 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 19:28:24.197622 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 18 19:28:24.197622 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:28:24.197622 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 258/500] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Aug 18 19:28:24 2022] GET /identity/v3/users/glance => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:28:24.197622 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4815832c-85fd-43eb-b3d5-ca17c8bee6bf None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:24.226917 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab6d47a-3ad3-46d5-a221-62123ce01b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:24.227537 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab6d47a-3ad3-46d5-a221-62123ce01b07 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:24.227812 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab6d47a-3ad3-46d5-a221-62123ce01b07 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:24.228080 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab6d47a-3ad3-46d5-a221-62123ce01b07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:24.239101 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab6d47a-3ad3-46d5-a221-62123ce01b07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:24.240551 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab6d47a-3ad3-46d5-a221-62123ce01b07 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:24.254620 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application [None req-4ab6d47a-3ad3-46d5-a221-62123ce01b07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:28:24.254620 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:24.254620 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:24.254620 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:24.254620 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:24.254620 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:24.254620 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:24.254620 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:24.254620 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:24.254620 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:24.254620 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:24.254620 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:24.254620 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 19:28:24.254620 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 19:28:24.254620 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 19:28:24.254620 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 19:28:24.255679 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:24.255679 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:24.255679 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:24.255679 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:24.255679 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:24.255679 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:24.255679 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:24.255679 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:24.255679 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:24.255679 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:24.255679 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:24.255679 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:24.255679 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:24.255679 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:24.255679 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:24.255679 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:24.255679 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 19:28:24.256517 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 19:28:24.256517 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:28:24.256517 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:28:24.256517 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 243/501] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Aug 18 19:28:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:28:24.256517 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab6d47a-3ad3-46d5-a221-62123ce01b07 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:24.284795 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:24.299971 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4815832c-85fd-43eb-b3d5-ca17c8bee6bf None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:24.333998 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eab709-6afe-42fa-9d07-124f20dea96c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:24.334603 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eab709-6afe-42fa-9d07-124f20dea96c None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:24.334871 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eab709-6afe-42fa-9d07-124f20dea96c None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:24.335139 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eab709-6afe-42fa-9d07-124f20dea96c None admin] PATH_INFO: `/v3/domains` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:24.335762 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eab709-6afe-42fa-9d07-124f20dea96c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:24.336059 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eab709-6afe-42fa-9d07-124f20dea96c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:24.337697 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eab709-6afe-42fa-9d07-124f20dea96c None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:24.348681 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 259/502] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Aug 18 19:28:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:24.349456 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eab709-6afe-42fa-9d07-124f20dea96c None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:24.358272 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab6d47a-3ad3-46d5-a221-62123ce01b07 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:24.387385 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:24.394207 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecc2519-e0ab-4fa9-a029-a2376110bb8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:24.394829 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc2519-e0ab-4fa9-a029-a2376110bb8f None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:24.395106 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc2519-e0ab-4fa9-a029-a2376110bb8f None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:24.395383 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc2519-e0ab-4fa9-a029-a2376110bb8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:24.405558 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecc2519-e0ab-4fa9-a029-a2376110bb8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:24.407018 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecc2519-e0ab-4fa9-a029-a2376110bb8f None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:24.421868 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application [None req-7ecc2519-e0ab-4fa9-a029-a2376110bb8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:28:24.421868 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:24.421868 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:24.421868 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:24.421868 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:24.421868 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:24.421868 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:24.421868 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:24.421868 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:24.421868 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:24.421868 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:24.421868 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:24.421868 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 19:28:24.421868 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 19:28:24.421868 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 19:28:24.421868 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 19:28:24.422772 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:24.422772 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:24.422772 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:24.422772 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:24.422772 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:24.422772 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:24.422772 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:24.422772 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:24.422772 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:24.422772 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:24.422772 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:24.422772 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:24.422772 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:24.422772 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:24.422772 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:24.422772 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:24.422772 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 19:28:24.423632 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 19:28:24.423632 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:28:24.423632 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:28:24.423632 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 244/503] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Aug 18 19:28:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:28:24.423853 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecc2519-e0ab-4fa9-a029-a2376110bb8f None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:24.448228 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eab709-6afe-42fa-9d07-124f20dea96c None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:24.480775 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997af102-e9aa-4a7f-850c-cb0bf41c1318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:24.481370 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997af102-e9aa-4a7f-850c-cb0bf41c1318 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:24.481641 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997af102-e9aa-4a7f-850c-cb0bf41c1318 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:24.481941 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997af102-e9aa-4a7f-850c-cb0bf41c1318 None admin] PATH_INFO: `/v3/users` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:24.483190 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997af102-e9aa-4a7f-850c-cb0bf41c1318 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:24.483491 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997af102-e9aa-4a7f-850c-cb0bf41c1318 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:24.484912 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997af102-e9aa-4a7f-850c-cb0bf41c1318 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:24.519967 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 260/504] 10.222.0.23 () {56 vars in 1137 bytes} [Thu Aug 18 19:28:24 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:24.524756 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997af102-e9aa-4a7f-850c-cb0bf41c1318 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:24.524853 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecc2519-e0ab-4fa9-a029-a2376110bb8f None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:24.524930 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:24.555069 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c2ecfb-ddf6-4ae6-8102-b9aa2764cb96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:24.555756 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c2ecfb-ddf6-4ae6-8102-b9aa2764cb96 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:24.556061 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c2ecfb-ddf6-4ae6-8102-b9aa2764cb96 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:24.556330 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c2ecfb-ddf6-4ae6-8102-b9aa2764cb96 None admin] PATH_INFO: `/v3/domains` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:24.556961 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c2ecfb-ddf6-4ae6-8102-b9aa2764cb96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:24.557266 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c2ecfb-ddf6-4ae6-8102-b9aa2764cb96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:24.558664 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c2ecfb-ddf6-4ae6-8102-b9aa2764cb96 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:24.570808 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 245/505] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Aug 18 19:28:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:24.571593 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c2ecfb-ddf6-4ae6-8102-b9aa2764cb96 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:24.613215 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:24.622634 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997af102-e9aa-4a7f-850c-cb0bf41c1318 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:24.656127 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d53c946-e2a6-4636-86d0-4454687197d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:24.656750 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d53c946-e2a6-4636-86d0-4454687197d1 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:24.657025 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d53c946-e2a6-4636-86d0-4454687197d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:24.657292 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d53c946-e2a6-4636-86d0-4454687197d1 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:24.664743 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d53c946-e2a6-4636-86d0-4454687197d1 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:24.666255 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d53c946-e2a6-4636-86d0-4454687197d1 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:24.669050 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c2ecfb-ddf6-4ae6-8102-b9aa2764cb96 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:24.677676 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application [None req-0d53c946-e2a6-4636-86d0-4454687197d1 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 18 19:28:24.677676 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:24.677676 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:24.677676 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:24.677676 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:24.677676 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:24.677676 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:24.677676 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:24.677676 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:24.677676 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:24.677676 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:24.677676 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:24.677676 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 19:28:24.677676 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 19:28:24.677676 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 19:28:24.677676 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 19:28:24.678760 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:24.678760 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:24.678760 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 19:28:24.678760 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 19:28:24.678760 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 19:28:24.678760 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 19:28:24.678760 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:24.678760 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:24.678760 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:24.678760 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:24.678760 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:24.678760 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:24.678760 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:24.678760 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:24.678760 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:24.678760 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:24.678760 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:24.678760 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:24.679721 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:24.679721 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:24.679721 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 19:28:24.679721 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 19:28:24.679721 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 19:28:24.679721 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 19:28:24.679721 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 19:28:24.679721 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 19:28:24.679721 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 18 19:28:24.679721 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:28:24.680669 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 261/506] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Aug 18 19:28:24 2022] GET /identity/v3/users/cinder => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:28:24.681542 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d53c946-e2a6-4636-86d0-4454687197d1 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:24.705065 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df02faef-8dfe-4592-ac3d-575db3ec1b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:24.705435 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df02faef-8dfe-4592-ac3d-575db3ec1b1c None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:24.705747 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df02faef-8dfe-4592-ac3d-575db3ec1b1c None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:24.706019 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df02faef-8dfe-4592-ac3d-575db3ec1b1c None admin] PATH_INFO: `/v3/domains` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:24.706649 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df02faef-8dfe-4592-ac3d-575db3ec1b1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:24.706948 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df02faef-8dfe-4592-ac3d-575db3ec1b1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:24.708298 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df02faef-8dfe-4592-ac3d-575db3ec1b1c None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:24.719786 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 246/507] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Aug 18 19:28:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:24.720366 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df02faef-8dfe-4592-ac3d-575db3ec1b1c None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:24.746678 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:24.785625 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d53c946-e2a6-4636-86d0-4454687197d1 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:24.818771 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df02faef-8dfe-4592-ac3d-575db3ec1b1c None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:24.819610 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae80c6f-f62b-4817-88c7-a62fabc358d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:24.820228 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae80c6f-f62b-4817-88c7-a62fabc358d1 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:24.820384 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:24.820510 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae80c6f-f62b-4817-88c7-a62fabc358d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:24.821117 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae80c6f-f62b-4817-88c7-a62fabc358d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:24.852255 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da90b3d6-f0a8-4046-b50b-b3e590de08df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:24.853197 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da90b3d6-f0a8-4046-b50b-b3e590de08df None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:24.853484 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da90b3d6-f0a8-4046-b50b-b3e590de08df None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:24.853790 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da90b3d6-f0a8-4046-b50b-b3e590de08df None admin] PATH_INFO: `/v3/projects/service` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:24.861377 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da90b3d6-f0a8-4046-b50b-b3e590de08df None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:24.862859 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da90b3d6-f0a8-4046-b50b-b3e590de08df None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:24.874585 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application [None req-da90b3d6-f0a8-4046-b50b-b3e590de08df None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 19:28:24.874585 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:24.874585 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:24.874585 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:24.874585 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:24.874585 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:24.874585 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:24.874585 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:24.874585 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:24.874585 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:24.874585 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:24.874585 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:24.874585 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 19:28:24.874585 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 19:28:24.874585 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 19:28:24.875618 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 19:28:24.875618 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:24.875618 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:24.875618 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:24.875618 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:24.875618 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:24.875618 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:24.875618 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:24.875618 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:24.875618 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:24.875618 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:24.875618 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:24.875618 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:24.875618 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:24.875618 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:24.875618 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:24.875618 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:24.876461 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 19:28:24.876461 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 19:28:24.876461 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 19:28:24.876461 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 19:28:24.876461 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 19:28:24.876461 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 19:28:24.876461 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 19:28:24.876461 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:28:24.876461 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 247/508] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Aug 18 19:28:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:28:24.876461 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da90b3d6-f0a8-4046-b50b-b3e590de08df None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:24.893637 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae80c6f-f62b-4817-88c7-a62fabc358d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:24.895130 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae80c6f-f62b-4817-88c7-a62fabc358d1 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:24.954861 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:24.985072 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da90b3d6-f0a8-4046-b50b-b3e590de08df None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:24.993227 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 262/509] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Aug 18 19:28:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 19:28:24.994080 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae80c6f-f62b-4817-88c7-a62fabc358d1 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:25.023213 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4e04e8-3167-475e-8a69-4e3ad1508769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:25.024676 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4e04e8-3167-475e-8a69-4e3ad1508769 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:25.024955 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4e04e8-3167-475e-8a69-4e3ad1508769 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:25.025221 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4e04e8-3167-475e-8a69-4e3ad1508769 None admin] PATH_INFO: `/v3/users` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:25.025966 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4e04e8-3167-475e-8a69-4e3ad1508769 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:25.026268 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4e04e8-3167-475e-8a69-4e3ad1508769 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:25.027698 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4e04e8-3167-475e-8a69-4e3ad1508769 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:25.046220 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 248/510] 10.222.0.23 () {56 vars in 1137 bytes} [Thu Aug 18 19:28:24 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:25.047097 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4e04e8-3167-475e-8a69-4e3ad1508769 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:25.073776 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:25.097546 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae80c6f-f62b-4817-88c7-a62fabc358d1 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:25.130772 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bef39b6-dfb7-4a3a-ae89-cce172c8dd44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:25.131429 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bef39b6-dfb7-4a3a-ae89-cce172c8dd44 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:25.131706 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bef39b6-dfb7-4a3a-ae89-cce172c8dd44 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:25.131979 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bef39b6-dfb7-4a3a-ae89-cce172c8dd44 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:25.139128 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bef39b6-dfb7-4a3a-ae89-cce172c8dd44 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:25.140584 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bef39b6-dfb7-4a3a-ae89-cce172c8dd44 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:25.150698 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4e04e8-3167-475e-8a69-4e3ad1508769 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:25.151987 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application [None req-2bef39b6-dfb7-4a3a-ae89-cce172c8dd44 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 18 19:28:25.151987 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:25.151987 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:25.151987 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:25.151987 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:25.151987 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:25.151987 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:25.151987 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:25.151987 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:25.151987 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:25.151987 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:25.151987 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:25.151987 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 19:28:25.151987 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 19:28:25.151987 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 19:28:25.151987 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 19:28:25.153059 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:25.153059 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:25.153059 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 19:28:25.153059 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 19:28:25.153059 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 19:28:25.153059 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 19:28:25.153059 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:25.153059 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:25.153059 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:25.153059 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:25.153059 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:25.153059 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:25.153059 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:25.153059 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:25.153059 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:25.153059 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:25.153059 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:25.153059 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:25.154208 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:25.154208 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:25.154208 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 19:28:25.154208 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 19:28:25.154208 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 19:28:25.154208 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 19:28:25.154208 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 19:28:25.154208 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 19:28:25.154208 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 18 19:28:25.154208 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:28:25.154208 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 263/511] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Aug 18 19:28:24 2022] GET /identity/v3/users/neutron => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:28:25.155454 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bef39b6-dfb7-4a3a-ae89-cce172c8dd44 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:25.179942 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:25.188251 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e708a61-a63d-4764-9535-7026682d34fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:25.190106 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e708a61-a63d-4764-9535-7026682d34fc None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:25.190106 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e708a61-a63d-4764-9535-7026682d34fc None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:25.190106 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e708a61-a63d-4764-9535-7026682d34fc None admin] PATH_INFO: `/v3/projects` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:25.190106 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e708a61-a63d-4764-9535-7026682d34fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:25.190393 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e708a61-a63d-4764-9535-7026682d34fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:25.191777 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e708a61-a63d-4764-9535-7026682d34fc None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:25.209852 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 249/512] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Aug 18 19:28:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:25.210649 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e708a61-a63d-4764-9535-7026682d34fc None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:25.254204 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bef39b6-dfb7-4a3a-ae89-cce172c8dd44 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:25.288796 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6225061b-483d-4b67-907d-6a533499f444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:25.289412 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6225061b-483d-4b67-907d-6a533499f444 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:25.289711 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6225061b-483d-4b67-907d-6a533499f444 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:25.289989 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6225061b-483d-4b67-907d-6a533499f444 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:25.291806 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:25.299995 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6225061b-483d-4b67-907d-6a533499f444 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:25.301434 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6225061b-483d-4b67-907d-6a533499f444 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:25.310482 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e708a61-a63d-4764-9535-7026682d34fc None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:25.315931 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application [None req-6225061b-483d-4b67-907d-6a533499f444 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:28:25.315931 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:25.315931 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:25.315931 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:25.315931 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:25.315931 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:25.315931 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:25.315931 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:25.315931 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:25.315931 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:25.315931 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:25.315931 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:25.315931 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 19:28:25.315931 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 19:28:25.315931 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 19:28:25.315931 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 19:28:25.317006 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:25.317006 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:25.317006 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:25.317006 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:25.317006 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:25.317006 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:25.317006 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:25.317006 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:25.317006 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:25.317006 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:25.317006 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:25.317006 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:25.317006 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:25.317006 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:25.317006 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:25.317006 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:25.317006 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 19:28:25.322651 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 19:28:25.322651 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:28:25.322651 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:28:25.322651 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 264/513] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Aug 18 19:28:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:28:25.322651 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6225061b-483d-4b67-907d-6a533499f444 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:25.345928 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a8b075-aa01-4cca-a10a-789beedca911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:25.346522 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a8b075-aa01-4cca-a10a-789beedca911 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:25.346795 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a8b075-aa01-4cca-a10a-789beedca911 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:25.347064 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a8b075-aa01-4cca-a10a-789beedca911 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:25.394863 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:25.414472 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a8b075-aa01-4cca-a10a-789beedca911 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:25.415977 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a8b075-aa01-4cca-a10a-789beedca911 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:25.418658 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6225061b-483d-4b67-907d-6a533499f444 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:25.452654 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad334cf-e9da-4e0f-a421-9c340492c2d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:25.453248 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad334cf-e9da-4e0f-a421-9c340492c2d6 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:25.453524 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad334cf-e9da-4e0f-a421-9c340492c2d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:25.453832 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad334cf-e9da-4e0f-a421-9c340492c2d6 None admin] PATH_INFO: `/v3/users` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:25.454545 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad334cf-e9da-4e0f-a421-9c340492c2d6 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:25.454846 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad334cf-e9da-4e0f-a421-9c340492c2d6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:25.456250 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad334cf-e9da-4e0f-a421-9c340492c2d6 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:25.473234 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 265/514] 10.222.0.23 () {56 vars in 1139 bytes} [Thu Aug 18 19:28:25 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:25.474073 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad334cf-e9da-4e0f-a421-9c340492c2d6 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:25.495850 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:25.515231 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 250/515] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Aug 18 19:28:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 19:28:25.516083 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a8b075-aa01-4cca-a10a-789beedca911 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:25.573445 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad334cf-e9da-4e0f-a421-9c340492c2d6 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:25.607316 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ef4206-0e99-4b12-a9fb-4ae052d87eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:25.608455 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ef4206-0e99-4b12-a9fb-4ae052d87eef None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:25.608728 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ef4206-0e99-4b12-a9fb-4ae052d87eef None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:25.608993 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ef4206-0e99-4b12-a9fb-4ae052d87eef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:25.609738 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ef4206-0e99-4b12-a9fb-4ae052d87eef None admin] RBAC: Adding query filter params (role.id=2a89ce9253da431fb2d0bf1ff51e1426, scope.project.id=a44b197c3aa0479092f4d77d2c791c39, user.id=9c3560e900d248bc93147ddce515365b) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:25.610041 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ef4206-0e99-4b12-a9fb-4ae052d87eef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:25.611621 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ef4206-0e99-4b12-a9fb-4ae052d87eef None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:25.613307 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:25.617345 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 266/516] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Aug 18 19:28:25 2022] GET /identity/v3/role_assignments?user.id=9c3560e900d248bc93147ddce515365b&scope.project.id=a44b197c3aa0479092f4d77d2c791c39&role.id=2a89ce9253da431fb2d0bf1ff51e1426 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:25.618046 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a8b075-aa01-4cca-a10a-789beedca911 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:25.618150 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ef4206-0e99-4b12-a9fb-4ae052d87eef None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:25.658352 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899b8ff5-f931-4d0a-ae04-c765b145b283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:25.658973 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899b8ff5-f931-4d0a-ae04-c765b145b283 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:25.659251 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899b8ff5-f931-4d0a-ae04-c765b145b283 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:25.659520 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899b8ff5-f931-4d0a-ae04-c765b145b283 None admin] PATH_INFO: `/v3/domains` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:25.660530 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899b8ff5-f931-4d0a-ae04-c765b145b283 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:25.660530 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899b8ff5-f931-4d0a-ae04-c765b145b283 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:25.661861 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899b8ff5-f931-4d0a-ae04-c765b145b283 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:25.679951 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 251/517] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Aug 18 19:28:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:25.679951 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899b8ff5-f931-4d0a-ae04-c765b145b283 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:25.724689 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:25.741689 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ef4206-0e99-4b12-a9fb-4ae052d87eef None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:25.780728 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c832ba-ba02-43f6-a428-48e98692a361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:25.780728 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c832ba-ba02-43f6-a428-48e98692a361 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:25.780728 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c832ba-ba02-43f6-a428-48e98692a361 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:25.780728 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c832ba-ba02-43f6-a428-48e98692a361 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:25.792203 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899b8ff5-f931-4d0a-ae04-c765b145b283 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:25.827377 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3773958-3210-4443-832d-6c4346f8aa6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:25.828002 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3773958-3210-4443-832d-6c4346f8aa6d None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:25.828331 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3773958-3210-4443-832d-6c4346f8aa6d None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:25.828599 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3773958-3210-4443-832d-6c4346f8aa6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:25.839694 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3773958-3210-4443-832d-6c4346f8aa6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:25.841130 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3773958-3210-4443-832d-6c4346f8aa6d None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:25.855317 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application [None req-c3773958-3210-4443-832d-6c4346f8aa6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:28:25.855317 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:25.855317 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:25.855317 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:25.855317 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:25.855317 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:25.855317 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:25.855317 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:25.855317 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:25.855317 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:25.855317 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:25.855317 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:25.855317 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 19:28:25.855317 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 19:28:25.855317 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 19:28:25.855317 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 19:28:25.856223 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:25.856223 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:25.856223 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:25.856223 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:25.856223 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:25.856223 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:25.856223 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:25.856223 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:25.856223 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:25.856223 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:25.856223 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:25.856223 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:25.856223 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:25.856223 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:25.856223 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:25.856223 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:25.856223 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 19:28:25.857108 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 19:28:25.857108 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:28:25.857108 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:28:25.857108 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 252/518] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Aug 18 19:28:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:28:25.858516 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3773958-3210-4443-832d-6c4346f8aa6d None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:25.858621 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:25.864564 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c832ba-ba02-43f6-a428-48e98692a361 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:25.866081 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c832ba-ba02-43f6-a428-48e98692a361 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:25.959048 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:25.967907 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3773958-3210-4443-832d-6c4346f8aa6d None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:25.969531 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 267/519] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Aug 18 19:28:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 19:28:25.974076 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c832ba-ba02-43f6-a428-48e98692a361 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:26.010153 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c17aff-8b77-4870-b703-f77dbacce473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:26.010847 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c17aff-8b77-4870-b703-f77dbacce473 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:26.011130 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c17aff-8b77-4870-b703-f77dbacce473 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:26.011403 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c17aff-8b77-4870-b703-f77dbacce473 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:26.018430 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c17aff-8b77-4870-b703-f77dbacce473 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:26.019857 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c17aff-8b77-4870-b703-f77dbacce473 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:26.033284 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application [None req-c2c17aff-8b77-4870-b703-f77dbacce473 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 19:28:26.033284 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:26.033284 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:26.033284 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:26.033284 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:26.033284 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:26.033284 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:26.033284 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:26.033284 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:26.033284 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:26.033284 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:26.033284 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:26.033284 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 19:28:26.033284 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 19:28:26.033284 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 19:28:26.034274 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 19:28:26.034274 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:26.034274 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:26.034274 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:26.034274 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:26.034274 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:26.034274 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:26.034274 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:26.034274 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:26.034274 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:26.034274 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:26.034274 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:26.034274 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:26.034274 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:26.034274 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:26.034274 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:26.034274 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:26.035604 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 19:28:26.035604 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 19:28:26.035604 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 19:28:26.035604 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 19:28:26.035604 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 19:28:26.035604 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 19:28:26.035604 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 19:28:26.035604 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:28:26.035604 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 253/520] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Aug 18 19:28:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:28:26.035604 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c17aff-8b77-4870-b703-f77dbacce473 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:26.079246 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:26.082993 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c832ba-ba02-43f6-a428-48e98692a361 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:26.119725 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6308a8b7-c082-43f3-a9d7-18e4601a132f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:26.120369 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6308a8b7-c082-43f3-a9d7-18e4601a132f None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:26.120645 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6308a8b7-c082-43f3-a9d7-18e4601a132f None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:26.120917 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6308a8b7-c082-43f3-a9d7-18e4601a132f None admin] PATH_INFO: `/v3/domains` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:26.121550 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6308a8b7-c082-43f3-a9d7-18e4601a132f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:26.121883 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6308a8b7-c082-43f3-a9d7-18e4601a132f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:26.123854 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6308a8b7-c082-43f3-a9d7-18e4601a132f None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:26.135680 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 268/521] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Aug 18 19:28:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:26.136474 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6308a8b7-c082-43f3-a9d7-18e4601a132f None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:26.183437 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c17aff-8b77-4870-b703-f77dbacce473 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:26.219393 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75fefbd-b40b-4cb2-8bf2-74bd235077d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:26.220055 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75fefbd-b40b-4cb2-8bf2-74bd235077d5 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:26.220334 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75fefbd-b40b-4cb2-8bf2-74bd235077d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:26.220776 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75fefbd-b40b-4cb2-8bf2-74bd235077d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:26.231631 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75fefbd-b40b-4cb2-8bf2-74bd235077d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:26.233617 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75fefbd-b40b-4cb2-8bf2-74bd235077d5 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:26.243271 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6308a8b7-c082-43f3-a9d7-18e4601a132f None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:26.248553 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application [None req-e75fefbd-b40b-4cb2-8bf2-74bd235077d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:28:26.248553 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:26.248553 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:26.248553 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:26.248553 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:26.248553 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:26.248553 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:26.248553 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:26.248553 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:26.248553 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:26.248553 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:26.248553 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:26.248553 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 19:28:26.248553 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 19:28:26.248553 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 19:28:26.248553 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 19:28:26.249459 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:26.249459 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:26.249459 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:26.249459 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:26.249459 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:26.249459 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:26.249459 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:26.249459 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:26.249459 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:26.249459 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:26.249459 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:26.249459 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:26.249459 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:26.249459 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:26.249459 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:26.249459 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:26.249459 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 19:28:26.255224 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 19:28:26.255224 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:28:26.255224 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:28:26.255224 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 254/522] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Aug 18 19:28:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:28:26.255224 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75fefbd-b40b-4cb2-8bf2-74bd235077d5 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:26.257189 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:26.285281 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c02c942-d126-49cc-a711-af1d9ca69833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:26.285917 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c02c942-d126-49cc-a711-af1d9ca69833 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:26.286176 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c02c942-d126-49cc-a711-af1d9ca69833 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:26.286451 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c02c942-d126-49cc-a711-af1d9ca69833 None admin] PATH_INFO: `/v3/projects` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:26.287134 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c02c942-d126-49cc-a711-af1d9ca69833 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:26.287438 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c02c942-d126-49cc-a711-af1d9ca69833 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:26.288874 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c02c942-d126-49cc-a711-af1d9ca69833 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:26.312000 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 269/523] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Aug 18 19:28:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:26.312000 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c02c942-d126-49cc-a711-af1d9ca69833 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:26.330183 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:26.363968 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75fefbd-b40b-4cb2-8bf2-74bd235077d5 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:26.400239 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3fcfc6-ac1c-491b-9e4c-c160b3fee7dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:26.400894 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3fcfc6-ac1c-491b-9e4c-c160b3fee7dd None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:26.401174 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3fcfc6-ac1c-491b-9e4c-c160b3fee7dd None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:26.401444 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3fcfc6-ac1c-491b-9e4c-c160b3fee7dd None admin] PATH_INFO: `/v3/projects/service` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:26.408228 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3fcfc6-ac1c-491b-9e4c-c160b3fee7dd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:26.409702 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3fcfc6-ac1c-491b-9e4c-c160b3fee7dd None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:26.416260 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c02c942-d126-49cc-a711-af1d9ca69833 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:26.421596 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application [None req-7f3fcfc6-ac1c-491b-9e4c-c160b3fee7dd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 19:28:26.421596 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:26.421596 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:26.421596 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:26.421596 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:26.421596 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:26.421596 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:26.421596 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:26.421596 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:26.421596 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:26.421596 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:26.421596 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:26.421596 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 19:28:26.421596 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 19:28:26.421596 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 19:28:26.422459 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 19:28:26.422459 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:26.422459 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:26.422459 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:26.422459 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:26.422459 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:26.422459 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:26.422459 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:26.422459 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:26.422459 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:26.422459 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:26.422459 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:26.422459 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:26.422459 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:26.422459 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:26.422459 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:26.422459 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:26.423294 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 19:28:26.423294 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 19:28:26.423294 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 19:28:26.423294 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 19:28:26.423294 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 19:28:26.423294 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 19:28:26.423294 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 19:28:26.423294 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:28:26.425968 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 255/524] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Aug 18 19:28:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:28:26.427432 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3fcfc6-ac1c-491b-9e4c-c160b3fee7dd None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:26.456567 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf126f7e-09a7-4db6-b088-d23a62c395cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:26.457181 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf126f7e-09a7-4db6-b088-d23a62c395cd None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:26.457458 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf126f7e-09a7-4db6-b088-d23a62c395cd None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:26.457764 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf126f7e-09a7-4db6-b088-d23a62c395cd None admin] PATH_INFO: `/v3/domains` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:26.458426 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf126f7e-09a7-4db6-b088-d23a62c395cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:26.458700 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf126f7e-09a7-4db6-b088-d23a62c395cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:26.460075 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf126f7e-09a7-4db6-b088-d23a62c395cd None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:26.471384 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 270/525] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Aug 18 19:28:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:26.472169 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf126f7e-09a7-4db6-b088-d23a62c395cd None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:26.501261 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:26.540600 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3fcfc6-ac1c-491b-9e4c-c160b3fee7dd None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:26.554161 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:26.575281 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf126f7e-09a7-4db6-b088-d23a62c395cd None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:26.579138 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff4fcde-f3d0-48fb-9846-e13c39f23002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:26.579747 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff4fcde-f3d0-48fb-9846-e13c39f23002 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:26.580029 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff4fcde-f3d0-48fb-9846-e13c39f23002 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:26.580304 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff4fcde-f3d0-48fb-9846-e13c39f23002 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:26.581029 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff4fcde-f3d0-48fb-9846-e13c39f23002 None admin] RBAC: Adding query filter params (role.id=2a89ce9253da431fb2d0bf1ff51e1426, scope.project.id=a44b197c3aa0479092f4d77d2c791c39, user.id=62ab2be725844b49bde7941867d672d1) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:26.581341 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff4fcde-f3d0-48fb-9846-e13c39f23002 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:26.582843 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff4fcde-f3d0-48fb-9846-e13c39f23002 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:26.589412 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 256/526] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Aug 18 19:28:26 2022] GET /identity/v3/role_assignments?user.id=62ab2be725844b49bde7941867d672d1&scope.project.id=a44b197c3aa0479092f4d77d2c791c39&role.id=2a89ce9253da431fb2d0bf1ff51e1426 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:26.590180 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff4fcde-f3d0-48fb-9846-e13c39f23002 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:26.628833 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bde82b-941a-4ce9-91ef-fbc4f9ae063b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:26.630161 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bde82b-941a-4ce9-91ef-fbc4f9ae063b None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:26.630649 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bde82b-941a-4ce9-91ef-fbc4f9ae063b None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:26.631124 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bde82b-941a-4ce9-91ef-fbc4f9ae063b None admin] PATH_INFO: `/v3/projects` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:26.632323 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bde82b-941a-4ce9-91ef-fbc4f9ae063b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:26.633903 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bde82b-941a-4ce9-91ef-fbc4f9ae063b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:26.635638 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bde82b-941a-4ce9-91ef-fbc4f9ae063b None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:26.659560 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 271/527] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Aug 18 19:28:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:26.665975 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bde82b-941a-4ce9-91ef-fbc4f9ae063b None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:26.712747 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff4fcde-f3d0-48fb-9846-e13c39f23002 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:26.743653 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:26.753086 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81319266-5a15-48f5-8754-cf5897f8e4c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:26.753729 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81319266-5a15-48f5-8754-cf5897f8e4c3 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:26.762582 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81319266-5a15-48f5-8754-cf5897f8e4c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:26.762582 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81319266-5a15-48f5-8754-cf5897f8e4c3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:26.762582 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81319266-5a15-48f5-8754-cf5897f8e4c3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:26.763576 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81319266-5a15-48f5-8754-cf5897f8e4c3 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:26.775995 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application [None req-81319266-5a15-48f5-8754-cf5897f8e4c3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 19:28:26.775995 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:26.775995 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:26.775995 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:26.775995 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:26.775995 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:26.775995 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:26.775995 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:26.775995 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:26.775995 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:26.775995 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:26.775995 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:26.775995 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 19:28:26.775995 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 19:28:26.775995 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 19:28:26.776862 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 19:28:26.776862 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:26.776862 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:26.776862 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:26.776862 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:26.776862 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:26.776862 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:26.776862 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:26.776862 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:26.776862 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:26.776862 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:26.776862 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:26.776862 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:26.776862 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:26.776862 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:26.776862 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:26.776862 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:26.777783 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 19:28:26.777783 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 19:28:26.777783 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 19:28:26.777783 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 19:28:26.777783 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 19:28:26.777783 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 19:28:26.777783 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 19:28:26.777783 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:28:26.778631 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 257/528] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Aug 18 19:28:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:28:26.784340 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81319266-5a15-48f5-8754-cf5897f8e4c3 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:26.797411 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bde82b-941a-4ce9-91ef-fbc4f9ae063b None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:26.839766 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376b87dd-b7dc-4f4b-baf2-42075320815c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:26.840378 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b87dd-b7dc-4f4b-baf2-42075320815c None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:26.840663 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b87dd-b7dc-4f4b-baf2-42075320815c None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:26.841210 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b87dd-b7dc-4f4b-baf2-42075320815c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:26.842482 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376b87dd-b7dc-4f4b-baf2-42075320815c None admin] RBAC: Adding query filter params (role.id=2a89ce9253da431fb2d0bf1ff51e1426, scope.project.id=a44b197c3aa0479092f4d77d2c791c39, user.id=28c99ca9206340269f30be592fcd3f75) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:26.842805 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376b87dd-b7dc-4f4b-baf2-42075320815c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:26.844518 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376b87dd-b7dc-4f4b-baf2-42075320815c None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:26.852194 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 272/529] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Aug 18 19:28:26 2022] GET /identity/v3/role_assignments?user.id=28c99ca9206340269f30be592fcd3f75&scope.project.id=a44b197c3aa0479092f4d77d2c791c39&role.id=2a89ce9253da431fb2d0bf1ff51e1426 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:26.911098 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81319266-5a15-48f5-8754-cf5897f8e4c3 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:26.950815 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2505724-943d-4d9b-bdfd-d7e82074d202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:26.951473 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2505724-943d-4d9b-bdfd-d7e82074d202 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:26.951749 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2505724-943d-4d9b-bdfd-d7e82074d202 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:26.952021 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2505724-943d-4d9b-bdfd-d7e82074d202 None admin] PATH_INFO: `/v3/projects` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:26.952722 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2505724-943d-4d9b-bdfd-d7e82074d202 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:26.953025 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2505724-943d-4d9b-bdfd-d7e82074d202 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:26.954505 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2505724-943d-4d9b-bdfd-d7e82074d202 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:26.969269 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 258/530] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Aug 18 19:28:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:28:26.975337 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376b87dd-b7dc-4f4b-baf2-42075320815c None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:26.986049 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:27.097564 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376b87dd-b7dc-4f4b-baf2-42075320815c None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:27.133591 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcea51d-85ad-4223-bf50-fbb6e549d06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:27.134226 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcea51d-85ad-4223-bf50-fbb6e549d06b None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:27.134502 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcea51d-85ad-4223-bf50-fbb6e549d06b None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:27.134812 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcea51d-85ad-4223-bf50-fbb6e549d06b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:27.135534 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcea51d-85ad-4223-bf50-fbb6e549d06b None admin] RBAC: Adding query filter params (role.id=2a89ce9253da431fb2d0bf1ff51e1426, scope.project.id=a44b197c3aa0479092f4d77d2c791c39, user.id=516923ce386f459190af3fd7eaa81551) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:27.135835 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcea51d-85ad-4223-bf50-fbb6e549d06b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:27.137296 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcea51d-85ad-4223-bf50-fbb6e549d06b None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:27.143493 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 273/531] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Aug 18 19:28:26 2022] GET /identity/v3/role_assignments?user.id=516923ce386f459190af3fd7eaa81551&scope.project.id=a44b197c3aa0479092f4d77d2c791c39&role.id=2a89ce9253da431fb2d0bf1ff51e1426 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:27.836754 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a0b58-f4a2-49b3-aa99-96c222f7370a None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:27.837309 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a0b58-f4a2-49b3-aa99-96c222f7370a None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:27.837584 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a0b58-f4a2-49b3-aa99-96c222f7370a None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:27.839288 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 259/532] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:28:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:28:27.844635 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2209714b-9a50-4de0-9f32-9ca206cdf23f None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:27.844923 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2209714b-9a50-4de0-9f32-9ca206cdf23f None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:27.845196 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2209714b-9a50-4de0-9f32-9ca206cdf23f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:27.863289 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-2209714b-9a50-4de0-9f32-9ca206cdf23f None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:28:27.864449 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-2209714b-9a50-4de0-9f32-9ca206cdf23f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:28:27.924478 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:27.932577 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 274/533] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:28:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:28:28.267853 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95a0b58-f4a2-49b3-aa99-96c222f7370a None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:28.323032 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:28.381611 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95a0b58-f4a2-49b3-aa99-96c222f7370a None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:28.418287 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c97ab9-2724-4602-807b-1147a8b64242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:28.418913 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c97ab9-2724-4602-807b-1147a8b64242 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:28.419193 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c97ab9-2724-4602-807b-1147a8b64242 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:28.419465 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c97ab9-2724-4602-807b-1147a8b64242 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:28.430141 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c97ab9-2724-4602-807b-1147a8b64242 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:28:28.434797 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application [None req-07c97ab9-2724-4602-807b-1147a8b64242 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 19:28:28.434797 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:28.434797 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:28.434797 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:28.434797 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:28.434797 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:28.434797 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:28.434797 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:28.434797 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:28.434797 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:28.434797 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:28.434797 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:28.434797 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:28:28.434797 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:28:28.434797 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:28:28.434797 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:28:28.435709 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:28:28.435709 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:28:28.435709 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:28:28.435709 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:28:28.435709 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:28.435709 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:28.435709 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:28.435709 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:28.435709 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:28.435709 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:28.435709 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:28.435709 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:28.435709 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:28.435709 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:28.435709 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:28.435709 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:28.436671 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:28.436671 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:28.436671 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:28.436671 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:28.436671 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:28:28.436671 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:28:28.436671 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:28:28.436671 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:28:28.436671 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:28:28.436671 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:28:28.436671 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 19:28:28.436671 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:28:28.436671 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 260/534] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Aug 18 19:28:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:28:28.442970 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2209714b-9a50-4de0-9f32-9ca206cdf23f None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:28.546199 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2209714b-9a50-4de0-9f32-9ca206cdf23f None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:28.583415 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a922d6-5e2f-4e6b-80b9-6391fb275ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:28.584253 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a922d6-5e2f-4e6b-80b9-6391fb275ce0 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:28.584676 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a922d6-5e2f-4e6b-80b9-6391fb275ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:28.592448 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a922d6-5e2f-4e6b-80b9-6391fb275ce0 None admin] PATH_INFO: `/v3/roles` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:28.592448 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a922d6-5e2f-4e6b-80b9-6391fb275ce0 None admin] RBAC: Adding query filter params (name=service) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:28.592448 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a922d6-5e2f-4e6b-80b9-6391fb275ce0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:28.592448 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a922d6-5e2f-4e6b-80b9-6391fb275ce0 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:28.596784 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 275/535] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Aug 18 19:28:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:28.601980 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c97ab9-2724-4602-807b-1147a8b64242 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:28.719988 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c97ab9-2724-4602-807b-1147a8b64242 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:28.729784 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:28.756732 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71d0802-f5e3-4727-83fe-4ced730acf28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:28.757363 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d0802-f5e3-4727-83fe-4ced730acf28 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:28.757638 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d0802-f5e3-4727-83fe-4ced730acf28 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:28.757937 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d0802-f5e3-4727-83fe-4ced730acf28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:28.769352 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71d0802-f5e3-4727-83fe-4ced730acf28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:28.770883 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71d0802-f5e3-4727-83fe-4ced730acf28 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:28.785874 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application [None req-f71d0802-f5e3-4727-83fe-4ced730acf28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:28:28.785874 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:28.785874 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:28.785874 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:28.785874 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:28.785874 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:28.785874 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:28.785874 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:28.785874 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:28.785874 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:28.785874 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:28.785874 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:28.785874 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 19:28:28.785874 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 19:28:28.785874 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 19:28:28.785874 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 19:28:28.786806 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:28.786806 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:28.786806 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:28.786806 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:28.786806 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:28.786806 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:28.786806 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:28.786806 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:28.786806 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:28.786806 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:28.786806 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:28.786806 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:28.786806 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:28.786806 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:28.786806 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:28.786806 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:28.786806 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 19:28:28.788229 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 19:28:28.788229 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:28:28.788229 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:28:28.788229 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 261/536] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Aug 18 19:28:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:28:28.795059 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a922d6-5e2f-4e6b-80b9-6391fb275ce0 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:28.799087 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8355c0d-c93f-41a4-8af4-f2bdb0dda0f3 None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:28.799306 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8355c0d-c93f-41a4-8af4-f2bdb0dda0f3 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:28.799577 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8355c0d-c93f-41a4-8af4-f2bdb0dda0f3 None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:28.800869 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 262/537] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:28:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:28:28.809690 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b699a88-d153-4c26-b31d-52b1205485c4 None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:28.809690 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b699a88-d153-4c26-b31d-52b1205485c4 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:28.809690 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b699a88-d153-4c26-b31d-52b1205485c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:28.824731 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-8b699a88-d153-4c26-b31d-52b1205485c4 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:28:28.826607 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-8b699a88-d153-4c26-b31d-52b1205485c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:28:28.882014 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:28.900160 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 263/538] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:28:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 19:28:28.921241 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a922d6-5e2f-4e6b-80b9-6391fb275ce0 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:28.956762 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d547939-a06c-4d01-8a9f-e3fa6d8cc35e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:28.957729 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d547939-a06c-4d01-8a9f-e3fa6d8cc35e None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:28.958207 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d547939-a06c-4d01-8a9f-e3fa6d8cc35e None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:28.958672 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d547939-a06c-4d01-8a9f-e3fa6d8cc35e None admin] PATH_INFO: `/v3/domains` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:28.959494 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d547939-a06c-4d01-8a9f-e3fa6d8cc35e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:28.960009 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d547939-a06c-4d01-8a9f-e3fa6d8cc35e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:28.961928 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d547939-a06c-4d01-8a9f-e3fa6d8cc35e None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:28.975275 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 276/539] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Aug 18 19:28:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:28.981715 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b699a88-d153-4c26-b31d-52b1205485c4 None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:29.082090 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:29.091368 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b699a88-d153-4c26-b31d-52b1205485c4 None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:29.126635 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70cd16f-38e3-47f0-b559-c4263172a662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:29.127256 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70cd16f-38e3-47f0-b559-c4263172a662 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:29.127532 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70cd16f-38e3-47f0-b559-c4263172a662 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:29.127804 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70cd16f-38e3-47f0-b559-c4263172a662 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:29.135142 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70cd16f-38e3-47f0-b559-c4263172a662 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:29.136580 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70cd16f-38e3-47f0-b559-c4263172a662 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:29.149687 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application [None req-e70cd16f-38e3-47f0-b559-c4263172a662 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 18 19:28:29.149687 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:29.149687 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:29.149687 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:29.149687 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:29.149687 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:29.149687 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:29.149687 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:29.149687 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:29.149687 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:29.149687 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:29.149687 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:29.149687 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 19:28:29.149687 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 19:28:29.149687 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 19:28:29.149687 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 19:28:29.150605 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:29.150605 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:29.150605 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 19:28:29.150605 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 19:28:29.150605 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 19:28:29.150605 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 19:28:29.150605 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:29.150605 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:29.150605 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:29.150605 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:29.150605 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:29.150605 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:29.150605 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:29.150605 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:29.150605 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:29.150605 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:29.150605 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:29.150605 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:29.151542 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:29.151542 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:29.151542 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 19:28:29.151542 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 19:28:29.151542 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 19:28:29.151542 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 19:28:29.151542 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 19:28:29.151542 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 19:28:29.151542 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 18 19:28:29.151542 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:28:29.151542 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 264/540] 10.222.0.23 () {56 vars in 1093 bytes} [Thu Aug 18 19:28:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:28:29.156726 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d547939-a06c-4d01-8a9f-e3fa6d8cc35e None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:29.212752 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da20bce6-6bb1-4baf-ab57-117af87e81ca None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:29.213070 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da20bce6-6bb1-4baf-ab57-117af87e81ca None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:29.213307 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da20bce6-6bb1-4baf-ab57-117af87e81ca None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:29.215894 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 265/541] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:28:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 19:28:29.219907 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f648dbc3-6336-4d2d-8dd7-2fced07e5f5c None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:29.220189 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f648dbc3-6336-4d2d-8dd7-2fced07e5f5c None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:29.220459 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f648dbc3-6336-4d2d-8dd7-2fced07e5f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:29.242043 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-f648dbc3-6336-4d2d-8dd7-2fced07e5f5c None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:28:29.243558 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-f648dbc3-6336-4d2d-8dd7-2fced07e5f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:28:29.267790 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d547939-a06c-4d01-8a9f-e3fa6d8cc35e None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:29.288965 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:29.306537 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786e8ba0-ddbf-4d4f-853f-15db2ba89363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:29.307139 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e8ba0-ddbf-4d4f-853f-15db2ba89363 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:29.307414 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e8ba0-ddbf-4d4f-853f-15db2ba89363 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:29.307686 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e8ba0-ddbf-4d4f-853f-15db2ba89363 None admin] PATH_INFO: `/v3/users` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:29.308400 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786e8ba0-ddbf-4d4f-853f-15db2ba89363 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:29.308698 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786e8ba0-ddbf-4d4f-853f-15db2ba89363 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:29.310237 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786e8ba0-ddbf-4d4f-853f-15db2ba89363 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:29.321922 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 266/542] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:28:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 19:28:29.322751 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f648dbc3-6336-4d2d-8dd7-2fced07e5f5c None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:29.344069 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 277/543] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Aug 18 19:28:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:29.344963 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786e8ba0-ddbf-4d4f-853f-15db2ba89363 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:29.421834 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:29.441309 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f648dbc3-6336-4d2d-8dd7-2fced07e5f5c None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:29.460276 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786e8ba0-ddbf-4d4f-853f-15db2ba89363 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:29.476740 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaa22aa-b524-4be9-8d5d-945d350564be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:29.477365 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa22aa-b524-4be9-8d5d-945d350564be None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:29.477646 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa22aa-b524-4be9-8d5d-945d350564be None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:29.477940 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa22aa-b524-4be9-8d5d-945d350564be None admin] PATH_INFO: `/v3/roles/service` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:29.489192 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaa22aa-b524-4be9-8d5d-945d350564be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:28:29.493871 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application [None req-aeaa22aa-b524-4be9-8d5d-945d350564be None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 19:28:29.493871 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:29.493871 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:29.493871 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:29.493871 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:29.493871 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:29.493871 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:29.493871 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:29.493871 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:29.493871 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:29.493871 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:29.493871 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:29.493871 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:28:29.493871 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:28:29.493871 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:28:29.493871 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:28:29.494717 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:28:29.494717 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:28:29.494717 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:28:29.494717 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:28:29.494717 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:29.494717 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:29.494717 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:29.494717 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:29.494717 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:29.494717 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:29.494717 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:29.494717 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:29.494717 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:29.494717 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:29.494717 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:29.494717 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:29.495505 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:29.495505 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:29.495505 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:29.495505 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:29.495505 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:28:29.495505 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:28:29.495505 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:28:29.495505 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:28:29.495505 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:28:29.495505 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:28:29.495505 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 19:28:29.495505 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:28:29.495505 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 267/544] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Aug 18 19:28:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:28:29.496156 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd87c0a4-5835-4741-b5ae-ef73bb9f8415 None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:29.496756 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd87c0a4-5835-4741-b5ae-ef73bb9f8415 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:29.496756 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd87c0a4-5835-4741-b5ae-ef73bb9f8415 None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:29.498088 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 268/545] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:28:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:28:29.501213 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ddcfa8-3acf-4332-bcf0-ade99b66c434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:29.501887 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ddcfa8-3acf-4332-bcf0-ade99b66c434 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:29.502163 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ddcfa8-3acf-4332-bcf0-ade99b66c434 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:29.502430 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ddcfa8-3acf-4332-bcf0-ade99b66c434 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:29.502585 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd87c0a4-5835-4741-b5ae-ef73bb9f8415 None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:29.512996 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ddcfa8-3acf-4332-bcf0-ade99b66c434 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:29.514520 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ddcfa8-3acf-4332-bcf0-ade99b66c434 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:29.530659 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application [None req-17ddcfa8-3acf-4332-bcf0-ade99b66c434 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:28:29.530659 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:29.530659 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:29.530659 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:29.530659 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:29.530659 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:29.530659 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:29.530659 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:29.530659 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:29.530659 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:29.530659 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:29.530659 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:29.530659 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 19:28:29.530659 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 19:28:29.530659 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 19:28:29.530659 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 19:28:29.531585 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:29.531585 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:29.531585 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:29.531585 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:29.531585 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:29.531585 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:29.531585 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:29.531585 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:29.531585 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:29.531585 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:29.531585 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:29.531585 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:29.531585 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:29.531585 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:29.531585 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:29.531585 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:29.531585 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 19:28:29.532433 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 19:28:29.532433 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:28:29.532433 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:28:29.532433 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 278/546] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Aug 18 19:28:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:28:29.533057 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96243f58-b223-4b4b-b172-e0269fe67dcb None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:29.533150 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96243f58-b223-4b4b-b172-e0269fe67dcb None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:29.533402 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96243f58-b223-4b4b-b172-e0269fe67dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:29.552536 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-96243f58-b223-4b4b-b172-e0269fe67dcb None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:28:29.553738 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-96243f58-b223-4b4b-b172-e0269fe67dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:28:29.576809 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:29.620813 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd87c0a4-5835-4741-b5ae-ef73bb9f8415 None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:29.621673 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 279/547] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:28:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:28:29.632898 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96243f58-b223-4b4b-b172-e0269fe67dcb None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:29.661518 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78434587-17b0-4e99-85e0-31a20a9a346d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:29.662163 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78434587-17b0-4e99-85e0-31a20a9a346d None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:29.662672 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78434587-17b0-4e99-85e0-31a20a9a346d None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:29.662779 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78434587-17b0-4e99-85e0-31a20a9a346d None admin] PATH_INFO: `/v3/roles` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:29.663344 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78434587-17b0-4e99-85e0-31a20a9a346d None admin] RBAC: Adding query filter params (name=service) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:29.663741 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78434587-17b0-4e99-85e0-31a20a9a346d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:29.665020 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78434587-17b0-4e99-85e0-31a20a9a346d None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:29.674279 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 269/548] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Aug 18 19:28:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:29.675113 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78434587-17b0-4e99-85e0-31a20a9a346d None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:29.681285 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:29.740575 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96243f58-b223-4b4b-b172-e0269fe67dcb None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:29.776923 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338318ad-359e-408d-b731-419d1cb33c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:29.778167 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338318ad-359e-408d-b731-419d1cb33c24 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:29.778427 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338318ad-359e-408d-b731-419d1cb33c24 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:29.778944 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338318ad-359e-408d-b731-419d1cb33c24 None admin] PATH_INFO: `/v3/domains` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:29.780473 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338318ad-359e-408d-b731-419d1cb33c24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:29.780927 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338318ad-359e-408d-b731-419d1cb33c24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:29.782337 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338318ad-359e-408d-b731-419d1cb33c24 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:29.782902 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78434587-17b0-4e99-85e0-31a20a9a346d None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:29.798230 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 280/549] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Aug 18 19:28:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:29.798230 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338318ad-359e-408d-b731-419d1cb33c24 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:29.814581 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:29.823604 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918e1dde-e9d0-449e-a5f8-8a4786464a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:29.824234 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918e1dde-e9d0-449e-a5f8-8a4786464a55 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:29.824514 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918e1dde-e9d0-449e-a5f8-8a4786464a55 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:29.824784 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918e1dde-e9d0-449e-a5f8-8a4786464a55 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:29.840222 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918e1dde-e9d0-449e-a5f8-8a4786464a55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:28:29.845950 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application [None req-918e1dde-e9d0-449e-a5f8-8a4786464a55 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 19:28:29.845950 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:29.845950 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:29.845950 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:29.845950 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:29.845950 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:29.845950 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:29.845950 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:29.845950 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:29.845950 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:29.845950 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:29.845950 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:29.845950 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:28:29.845950 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:28:29.845950 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:28:29.845950 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:28:29.846819 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:28:29.846819 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:28:29.846819 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:28:29.846819 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:28:29.846819 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:29.846819 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:29.846819 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:29.846819 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:29.846819 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:29.846819 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:29.846819 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:29.846819 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:29.846819 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:29.846819 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:29.846819 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:29.846819 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:29.850445 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:29.850445 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:29.850445 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:29.850445 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:29.850445 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:28:29.850445 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:28:29.850445 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:28:29.850445 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:28:29.850445 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:28:29.850445 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:28:29.850445 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 19:28:29.850445 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:28:29.850445 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 270/550] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Aug 18 19:28:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:28:29.850445 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918e1dde-e9d0-449e-a5f8-8a4786464a55 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:29.902434 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338318ad-359e-408d-b731-419d1cb33c24 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:29.918141 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:29.939543 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d8a620-0204-43bf-8c16-2cef246933aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:29.940229 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d8a620-0204-43bf-8c16-2cef246933aa None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:29.940511 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d8a620-0204-43bf-8c16-2cef246933aa None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:29.940777 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d8a620-0204-43bf-8c16-2cef246933aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:29.952647 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d8a620-0204-43bf-8c16-2cef246933aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:29.954139 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d8a620-0204-43bf-8c16-2cef246933aa None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:29.956547 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918e1dde-e9d0-449e-a5f8-8a4786464a55 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:29.969027 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application [None req-84d8a620-0204-43bf-8c16-2cef246933aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:28:29.969027 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:29.969027 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:29.969027 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:29.969027 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:29.969027 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:29.969027 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:29.969027 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:29.969027 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:29.969027 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:29.969027 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:29.969027 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:29.969027 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 19:28:29.969027 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 19:28:29.969027 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 19:28:29.969027 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 19:28:29.970439 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:29.970439 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:29.970439 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:29.970439 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:29.970439 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:29.970439 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:29.970439 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:29.970439 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:29.970439 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:29.970439 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:29.970439 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:29.970439 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:29.970439 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:29.970439 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:29.970439 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:29.970439 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:29.970439 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 19:28:29.971449 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 19:28:29.971449 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:28:29.971449 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:28:29.971449 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 281/551] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Aug 18 19:28:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:28:29.971449 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d8a620-0204-43bf-8c16-2cef246933aa None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:29.996201 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d0bf7e-a3c3-4d17-9d3c-d0c492b0845e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:29.996837 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d0bf7e-a3c3-4d17-9d3c-d0c492b0845e None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:29.997119 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d0bf7e-a3c3-4d17-9d3c-d0c492b0845e None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:29.997392 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d0bf7e-a3c3-4d17-9d3c-d0c492b0845e None admin] PATH_INFO: `/v3/projects/service` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:30.003961 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d0bf7e-a3c3-4d17-9d3c-d0c492b0845e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:30.005390 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d0bf7e-a3c3-4d17-9d3c-d0c492b0845e None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:30.016875 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application [None req-91d0bf7e-a3c3-4d17-9d3c-d0c492b0845e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 19:28:30.016875 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:30.016875 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:30.016875 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:30.016875 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:30.016875 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:30.016875 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:30.016875 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:30.016875 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:30.016875 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:30.016875 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:30.016875 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:30.016875 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 19:28:30.016875 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 19:28:30.016875 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 19:28:30.017855 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 19:28:30.017855 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:30.017855 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:30.017855 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:30.017855 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:30.017855 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:30.017855 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:30.017855 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:30.017855 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:30.017855 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:30.017855 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:30.017855 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:30.017855 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:30.017855 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:30.017855 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:30.017855 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:30.017855 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:30.018737 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 19:28:30.018737 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 19:28:30.018737 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 19:28:30.018737 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 19:28:30.018737 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 19:28:30.018737 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 19:28:30.018737 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 19:28:30.018737 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:28:30.018737 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 271/552] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Aug 18 19:28:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:28:30.019610 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d0bf7e-a3c3-4d17-9d3c-d0c492b0845e None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:30.048419 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:30.083071 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d8a620-0204-43bf-8c16-2cef246933aa None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:30.116087 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb13cc6-b857-426e-8617-922344814cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:30.116623 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb13cc6-b857-426e-8617-922344814cf9 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:30.116902 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb13cc6-b857-426e-8617-922344814cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:30.117182 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb13cc6-b857-426e-8617-922344814cf9 None admin] PATH_INFO: `/v3/roles` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:30.117858 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb13cc6-b857-426e-8617-922344814cf9 None admin] RBAC: Adding query filter params (name=service) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:30.118163 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb13cc6-b857-426e-8617-922344814cf9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:30.119542 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb13cc6-b857-426e-8617-922344814cf9 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:30.119792 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d0bf7e-a3c3-4d17-9d3c-d0c492b0845e None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:30.127729 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 282/553] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Aug 18 19:28:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:30.128538 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb13cc6-b857-426e-8617-922344814cf9 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:30.146231 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:30.157530 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fcb8b2-014a-4c66-9c2e-32e679db993a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:30.158185 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fcb8b2-014a-4c66-9c2e-32e679db993a None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:30.158467 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fcb8b2-014a-4c66-9c2e-32e679db993a None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:30.158741 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fcb8b2-014a-4c66-9c2e-32e679db993a None admin] PATH_INFO: `/v3/roles/service` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:30.169152 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fcb8b2-014a-4c66-9c2e-32e679db993a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:28:30.174312 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application [None req-05fcb8b2-014a-4c66-9c2e-32e679db993a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 19:28:30.174312 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:30.174312 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:30.174312 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:30.174312 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:30.174312 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:30.174312 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:30.174312 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:30.174312 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:30.174312 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:30.174312 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:30.174312 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:30.174312 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:28:30.174312 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:28:30.174312 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:28:30.174312 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:28:30.175432 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:28:30.175432 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:28:30.175432 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:28:30.175432 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:28:30.175432 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:30.175432 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:30.175432 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:30.175432 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:30.175432 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:30.175432 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:30.175432 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:30.175432 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:30.175432 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:30.175432 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:30.175432 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:30.175432 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:30.176442 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:30.176442 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:30.176442 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:30.176442 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:30.176442 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:28:30.176442 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:28:30.176442 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:28:30.176442 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:28:30.176442 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:28:30.176442 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:28:30.176442 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 19:28:30.176442 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:28:30.176442 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 272/554] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Aug 18 19:28:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:28:30.176442 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fcb8b2-014a-4c66-9c2e-32e679db993a None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:30.231746 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb13cc6-b857-426e-8617-922344814cf9 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:30.260144 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:30.265626 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d43de18-99a9-4db7-82cf-275f07102840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:30.266316 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d43de18-99a9-4db7-82cf-275f07102840 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:30.268294 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d43de18-99a9-4db7-82cf-275f07102840 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:30.268294 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d43de18-99a9-4db7-82cf-275f07102840 None admin] PATH_INFO: `/v3/domains` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:30.268294 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d43de18-99a9-4db7-82cf-275f07102840 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:30.268294 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d43de18-99a9-4db7-82cf-275f07102840 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:30.269157 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d43de18-99a9-4db7-82cf-275f07102840 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:30.280077 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fcb8b2-014a-4c66-9c2e-32e679db993a None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:30.280901 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 283/555] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Aug 18 19:28:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:30.281715 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d43de18-99a9-4db7-82cf-275f07102840 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:30.318509 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789d6f7e-bf27-4e6f-997e-0469fe2d8324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:30.319398 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d6f7e-bf27-4e6f-997e-0469fe2d8324 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:30.319684 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d6f7e-bf27-4e6f-997e-0469fe2d8324 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:30.319956 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d6f7e-bf27-4e6f-997e-0469fe2d8324 None admin] PATH_INFO: `/v3/projects` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:30.320643 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789d6f7e-bf27-4e6f-997e-0469fe2d8324 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:30.320947 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789d6f7e-bf27-4e6f-997e-0469fe2d8324 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:30.322409 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789d6f7e-bf27-4e6f-997e-0469fe2d8324 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:30.334809 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 273/556] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Aug 18 19:28:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:30.335597 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789d6f7e-bf27-4e6f-997e-0469fe2d8324 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:30.378275 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:30.386441 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d43de18-99a9-4db7-82cf-275f07102840 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:30.420614 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f34fce5-b79b-487a-854d-c20715dee195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:30.421229 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f34fce5-b79b-487a-854d-c20715dee195 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:30.421502 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f34fce5-b79b-487a-854d-c20715dee195 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:30.421829 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f34fce5-b79b-487a-854d-c20715dee195 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:30.431599 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f34fce5-b79b-487a-854d-c20715dee195 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:30.433056 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f34fce5-b79b-487a-854d-c20715dee195 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:30.433390 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789d6f7e-bf27-4e6f-997e-0469fe2d8324 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:30.448188 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application [None req-5f34fce5-b79b-487a-854d-c20715dee195 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:28:30.448188 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:30.448188 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:30.448188 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:30.448188 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:30.448188 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:30.448188 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:30.448188 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:30.448188 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:30.448188 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:30.448188 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:30.448188 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:30.448188 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 19:28:30.448188 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 19:28:30.448188 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 19:28:30.448188 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 19:28:30.454012 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:30.454012 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:30.454012 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:30.454012 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:30.454012 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:30.454012 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:30.454012 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:30.454012 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:30.454012 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:30.454012 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:30.454012 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:30.454012 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:30.454012 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:30.454012 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:30.454012 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:30.454012 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:30.454012 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 19:28:30.455250 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 19:28:30.455250 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:28:30.455250 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:28:30.455250 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 284/557] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Aug 18 19:28:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:28:30.455250 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f34fce5-b79b-487a-854d-c20715dee195 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:30.469629 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e7ee85-c468-4c37-95f0-5ab2447c2a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:30.470276 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e7ee85-c468-4c37-95f0-5ab2447c2a0d None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:30.470550 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e7ee85-c468-4c37-95f0-5ab2447c2a0d None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:30.470816 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e7ee85-c468-4c37-95f0-5ab2447c2a0d None admin] PATH_INFO: `/v3/roles` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:30.471489 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e7ee85-c468-4c37-95f0-5ab2447c2a0d None admin] RBAC: Adding query filter params (name=service) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:30.471785 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e7ee85-c468-4c37-95f0-5ab2447c2a0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:30.473123 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e7ee85-c468-4c37-95f0-5ab2447c2a0d None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:30.481484 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 274/558] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Aug 18 19:28:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:30.483052 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e7ee85-c468-4c37-95f0-5ab2447c2a0d None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:30.499795 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:30.554522 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f34fce5-b79b-487a-854d-c20715dee195 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:30.582487 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e7ee85-c468-4c37-95f0-5ab2447c2a0d None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:30.584773 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:30.588476 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc0e4d5-3060-46c2-93f4-0ec5df93f128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:30.589098 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc0e4d5-3060-46c2-93f4-0ec5df93f128 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:30.589377 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc0e4d5-3060-46c2-93f4-0ec5df93f128 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:30.589646 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc0e4d5-3060-46c2-93f4-0ec5df93f128 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:30.597008 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc0e4d5-3060-46c2-93f4-0ec5df93f128 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:30.598480 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc0e4d5-3060-46c2-93f4-0ec5df93f128 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:30.609882 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application [None req-1bc0e4d5-3060-46c2-93f4-0ec5df93f128 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 18 19:28:30.609882 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:30.609882 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:30.609882 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:30.609882 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:30.609882 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:30.609882 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:30.609882 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:30.609882 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:30.609882 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:30.609882 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:30.609882 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:30.609882 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 19:28:30.609882 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 19:28:30.609882 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 19:28:30.609882 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 19:28:30.611475 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:30.611475 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:30.611475 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 19:28:30.611475 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 19:28:30.611475 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 19:28:30.611475 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 19:28:30.611475 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:30.611475 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:30.611475 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:30.611475 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:30.611475 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:30.611475 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:30.611475 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:30.611475 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:30.611475 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:30.611475 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:30.611475 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:30.611475 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:30.612496 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:30.612496 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:30.612496 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 19:28:30.612496 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 19:28:30.612496 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 19:28:30.612496 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 19:28:30.612496 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 19:28:30.612496 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 19:28:30.612496 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 18 19:28:30.612496 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:28:30.612496 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 285/559] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Aug 18 19:28:30 2022] GET /identity/v3/users/glance => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:28:30.612496 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc0e4d5-3060-46c2-93f4-0ec5df93f128 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:30.621478 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cede2973-3d1a-4228-a020-4b3a597dfa29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:30.622172 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede2973-3d1a-4228-a020-4b3a597dfa29 None admin] REQUEST_METHOD: `PUT` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:30.622453 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede2973-3d1a-4228-a020-4b3a597dfa29 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:30.623308 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede2973-3d1a-4228-a020-4b3a597dfa29 None admin] PATH_INFO: `/v3/projects/a44b197c3aa0479092f4d77d2c791c39/users/9c3560e900d248bc93147ddce515365b/roles/2a89ce9253da431fb2d0bf1ff51e1426` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:30.637703 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cede2973-3d1a-4228-a020-4b3a597dfa29 None admin] RBAC: Authorizing `identity:create_grant(project_id=a44b197c3aa0479092f4d77d2c791c39, user_id=9c3560e900d248bc93147ddce515365b, role_id=2a89ce9253da431fb2d0bf1ff51e1426)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:30.639111 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cede2973-3d1a-4228-a020-4b3a597dfa29 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:30.709178 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc0e4d5-3060-46c2-93f4-0ec5df93f128 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:30.711733 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:30.722034 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 275/560] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Aug 18 19:28:30 2022] PUT /identity/v3/projects/a44b197c3aa0479092f4d77d2c791c39/users/9c3560e900d248bc93147ddce515365b/roles/2a89ce9253da431fb2d0bf1ff51e1426 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 19:28:30.722838 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cede2973-3d1a-4228-a020-4b3a597dfa29 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:30.745222 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9bf3a4-5bdb-4d07-a5be-5b45cfe47772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:30.745868 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9bf3a4-5bdb-4d07-a5be-5b45cfe47772 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:30.746152 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9bf3a4-5bdb-4d07-a5be-5b45cfe47772 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:30.746427 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9bf3a4-5bdb-4d07-a5be-5b45cfe47772 None admin] PATH_INFO: `/v3/domains` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:30.747080 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9bf3a4-5bdb-4d07-a5be-5b45cfe47772 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:30.747392 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9bf3a4-5bdb-4d07-a5be-5b45cfe47772 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:30.749405 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9bf3a4-5bdb-4d07-a5be-5b45cfe47772 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:30.767216 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 286/561] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Aug 18 19:28:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:30.767216 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9bf3a4-5bdb-4d07-a5be-5b45cfe47772 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:30.834271 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cede2973-3d1a-4228-a020-4b3a597dfa29 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:30.872412 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b395f63b-db7d-4dd9-9b23-fc472ef5182c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:30.873086 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b395f63b-db7d-4dd9-9b23-fc472ef5182c None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:30.873368 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b395f63b-db7d-4dd9-9b23-fc472ef5182c None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:30.873641 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b395f63b-db7d-4dd9-9b23-fc472ef5182c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:30.881601 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9bf3a4-5bdb-4d07-a5be-5b45cfe47772 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:30.885933 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b395f63b-db7d-4dd9-9b23-fc472ef5182c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:30.887420 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b395f63b-db7d-4dd9-9b23-fc472ef5182c None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:30.904614 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application [None req-b395f63b-db7d-4dd9-9b23-fc472ef5182c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:28:30.904614 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:30.904614 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:30.904614 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:30.904614 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:30.904614 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:30.904614 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:30.904614 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:30.904614 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:30.904614 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:30.904614 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:30.904614 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:30.904614 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 19:28:30.904614 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 19:28:30.904614 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 19:28:30.904614 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 19:28:30.905805 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:30.905805 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:30.905805 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:30.905805 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:30.905805 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:30.905805 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:30.905805 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:30.905805 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:30.905805 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:30.905805 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:30.905805 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:30.905805 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:30.905805 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:30.905805 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:30.905805 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:30.905805 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:30.905805 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 19:28:30.906693 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 19:28:30.906693 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:28:30.906693 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:28:30.906693 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 276/562] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Aug 18 19:28:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:28:30.906693 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b395f63b-db7d-4dd9-9b23-fc472ef5182c None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:30.918203 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:30.928681 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ebd3f-43b2-450d-8810-78fdb7d8e771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:30.929608 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ebd3f-43b2-450d-8810-78fdb7d8e771 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:30.929933 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ebd3f-43b2-450d-8810-78fdb7d8e771 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:30.930208 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ebd3f-43b2-450d-8810-78fdb7d8e771 None admin] PATH_INFO: `/v3/users` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:30.930997 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113ebd3f-43b2-450d-8810-78fdb7d8e771 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:30.931310 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113ebd3f-43b2-450d-8810-78fdb7d8e771 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:30.933207 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113ebd3f-43b2-450d-8810-78fdb7d8e771 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:30.956964 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 287/563] 10.222.0.23 () {56 vars in 1137 bytes} [Thu Aug 18 19:28:30 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:30.958200 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ebd3f-43b2-450d-8810-78fdb7d8e771 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:30.987305 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:31.017865 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b395f63b-db7d-4dd9-9b23-fc472ef5182c None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:31.056203 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b094478-5b52-4a22-91a7-111c169694d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:31.056905 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b094478-5b52-4a22-91a7-111c169694d9 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:31.057186 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b094478-5b52-4a22-91a7-111c169694d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:31.057460 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b094478-5b52-4a22-91a7-111c169694d9 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:31.071881 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b094478-5b52-4a22-91a7-111c169694d9 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:31.073800 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b094478-5b52-4a22-91a7-111c169694d9 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:31.078816 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ebd3f-43b2-450d-8810-78fdb7d8e771 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:31.088386 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application [None req-4b094478-5b52-4a22-91a7-111c169694d9 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 18 19:28:31.088386 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:31.088386 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:31.088386 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:31.088386 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:31.088386 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:31.088386 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:31.088386 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:31.088386 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:31.088386 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:31.088386 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:31.088386 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:31.088386 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 19:28:31.088386 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 19:28:31.088386 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 19:28:31.088386 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 19:28:31.089360 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:31.089360 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:31.089360 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 19:28:31.089360 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 19:28:31.089360 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 19:28:31.089360 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 19:28:31.089360 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:31.089360 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:31.089360 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:31.089360 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:31.089360 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:31.089360 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:31.089360 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:31.089360 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:31.089360 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:31.089360 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:31.089360 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:31.089360 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:31.090351 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:31.090351 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:31.090351 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 19:28:31.090351 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 19:28:31.090351 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 19:28:31.090351 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 19:28:31.090351 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 19:28:31.090351 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 19:28:31.090351 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 18 19:28:31.090351 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:28:31.090966 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 277/564] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Aug 18 19:28:30 2022] GET /identity/v3/users/cinder => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:28:31.092160 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b094478-5b52-4a22-91a7-111c169694d9 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:31.131805 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394bdc50-2cf1-4efb-bd0f-e3bfe711d8cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:31.132411 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394bdc50-2cf1-4efb-bd0f-e3bfe711d8cf None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:31.132689 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394bdc50-2cf1-4efb-bd0f-e3bfe711d8cf None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:31.132959 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394bdc50-2cf1-4efb-bd0f-e3bfe711d8cf None admin] PATH_INFO: `/v3/domains` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:31.133617 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394bdc50-2cf1-4efb-bd0f-e3bfe711d8cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:31.133922 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394bdc50-2cf1-4efb-bd0f-e3bfe711d8cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:31.135421 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394bdc50-2cf1-4efb-bd0f-e3bfe711d8cf None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:31.152025 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 288/565] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Aug 18 19:28:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:31.152025 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394bdc50-2cf1-4efb-bd0f-e3bfe711d8cf None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:31.165708 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:31.209855 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b094478-5b52-4a22-91a7-111c169694d9 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:31.248443 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb6b73b-b46d-4d74-a1a2-9319b85dc1aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:31.249073 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb6b73b-b46d-4d74-a1a2-9319b85dc1aa None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:31.249349 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb6b73b-b46d-4d74-a1a2-9319b85dc1aa None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:31.249616 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb6b73b-b46d-4d74-a1a2-9319b85dc1aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:31.250995 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:31.260134 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb6b73b-b46d-4d74-a1a2-9319b85dc1aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:31.261576 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb6b73b-b46d-4d74-a1a2-9319b85dc1aa None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:31.270004 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394bdc50-2cf1-4efb-bd0f-e3bfe711d8cf None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:31.276232 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application [None req-ccb6b73b-b46d-4d74-a1a2-9319b85dc1aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:28:31.276232 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:31.276232 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:31.276232 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:31.276232 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:31.276232 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:31.276232 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:31.276232 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:31.276232 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:31.276232 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:31.276232 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:31.276232 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:31.276232 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 19:28:31.276232 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 19:28:31.276232 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 19:28:31.276232 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 19:28:31.277189 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:31.277189 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:31.277189 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:31.277189 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:31.277189 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:31.277189 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:31.277189 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:31.277189 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:31.277189 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:31.277189 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:31.277189 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:31.277189 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:31.277189 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:31.277189 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:31.277189 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:31.277189 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:31.277189 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 19:28:31.278672 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 19:28:31.278672 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:28:31.278672 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:28:31.278672 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 278/566] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Aug 18 19:28:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:28:31.280875 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb6b73b-b46d-4d74-a1a2-9319b85dc1aa None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:31.308104 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2b4d3e-02b0-4be0-8275-82637a04e02b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:31.308706 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b4d3e-02b0-4be0-8275-82637a04e02b None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:31.309005 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b4d3e-02b0-4be0-8275-82637a04e02b None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:31.309249 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b4d3e-02b0-4be0-8275-82637a04e02b None admin] PATH_INFO: `/v3/users` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:31.310228 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2b4d3e-02b0-4be0-8275-82637a04e02b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:31.310335 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2b4d3e-02b0-4be0-8275-82637a04e02b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:31.311706 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2b4d3e-02b0-4be0-8275-82637a04e02b None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:31.334000 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 289/567] 10.222.0.23 () {56 vars in 1137 bytes} [Thu Aug 18 19:28:31 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:31.335354 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2b4d3e-02b0-4be0-8275-82637a04e02b None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:31.392871 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb6b73b-b46d-4d74-a1a2-9319b85dc1aa None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:31.411622 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:31.428647 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba84400-d433-4b91-902b-126c28ae1929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:31.429195 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba84400-d433-4b91-902b-126c28ae1929 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:31.429473 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba84400-d433-4b91-902b-126c28ae1929 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:31.429778 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba84400-d433-4b91-902b-126c28ae1929 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:31.438360 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba84400-d433-4b91-902b-126c28ae1929 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:31.439808 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba84400-d433-4b91-902b-126c28ae1929 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:31.440037 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2b4d3e-02b0-4be0-8275-82637a04e02b None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:31.451550 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application [None req-fba84400-d433-4b91-902b-126c28ae1929 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 18 19:28:31.451550 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:31.451550 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:31.451550 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:31.451550 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:31.451550 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:31.451550 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:31.451550 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:31.451550 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:31.451550 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:31.451550 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:31.451550 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:31.451550 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 19:28:31.451550 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 19:28:31.451550 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 19:28:31.451550 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 19:28:31.452579 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:31.452579 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:31.452579 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 19:28:31.452579 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 19:28:31.452579 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 19:28:31.452579 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 19:28:31.452579 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:31.452579 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:31.452579 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:31.452579 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:31.452579 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:31.452579 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:31.452579 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:31.452579 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:31.452579 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:31.452579 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:31.452579 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:31.452579 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:31.453527 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:31.453527 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:31.453527 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 19:28:31.453527 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 19:28:31.453527 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 19:28:31.453527 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 19:28:31.453527 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 19:28:31.453527 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 19:28:31.453527 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 18 19:28:31.453527 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:28:31.457781 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 279/568] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Aug 18 19:28:31 2022] GET /identity/v3/users/neutron => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:28:31.458647 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba84400-d433-4b91-902b-126c28ae1929 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:31.484920 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fa2fed-8017-4eb3-bd11-ec1abf9cd1ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:31.485521 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa2fed-8017-4eb3-bd11-ec1abf9cd1ec None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:31.485843 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa2fed-8017-4eb3-bd11-ec1abf9cd1ec None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:31.486112 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa2fed-8017-4eb3-bd11-ec1abf9cd1ec None admin] PATH_INFO: `/v3/domains` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:31.486732 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fa2fed-8017-4eb3-bd11-ec1abf9cd1ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:31.487037 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fa2fed-8017-4eb3-bd11-ec1abf9cd1ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:31.488498 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fa2fed-8017-4eb3-bd11-ec1abf9cd1ec None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:31.496896 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:31.504390 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 290/569] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Aug 18 19:28:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:31.504390 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fa2fed-8017-4eb3-bd11-ec1abf9cd1ec None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:31.570785 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba84400-d433-4b91-902b-126c28ae1929 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:31.605709 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5a471d-77c7-435f-a522-53be30c59bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:31.606345 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a471d-77c7-435f-a522-53be30c59bf4 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:31.606630 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a471d-77c7-435f-a522-53be30c59bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:31.606933 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a471d-77c7-435f-a522-53be30c59bf4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:31.608443 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fa2fed-8017-4eb3-bd11-ec1abf9cd1ec None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:31.621460 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5a471d-77c7-435f-a522-53be30c59bf4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:31.621460 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5a471d-77c7-435f-a522-53be30c59bf4 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:31.636221 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application [None req-de5a471d-77c7-435f-a522-53be30c59bf4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:28:31.636221 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:31.636221 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:31.636221 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:31.636221 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:31.636221 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:31.636221 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:31.636221 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:31.636221 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:31.636221 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:31.636221 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:31.636221 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:31.636221 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 19:28:31.636221 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 19:28:31.636221 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 19:28:31.636221 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 19:28:31.637562 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:31.637562 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:31.637562 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:31.637562 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:31.637562 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:31.637562 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:31.637562 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:31.637562 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:31.637562 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:31.637562 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:31.637562 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:31.637562 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:31.637562 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:31.637562 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:31.637562 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:31.637562 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:31.637562 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 19:28:31.639478 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 19:28:31.639478 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:28:31.639478 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:28:31.642133 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 280/570] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Aug 18 19:28:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:28:31.643796 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5a471d-77c7-435f-a522-53be30c59bf4 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:31.654020 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40dabf9-9a14-4373-abfe-ee2d23f09e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:31.654661 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40dabf9-9a14-4373-abfe-ee2d23f09e12 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:31.655040 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40dabf9-9a14-4373-abfe-ee2d23f09e12 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:31.655302 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40dabf9-9a14-4373-abfe-ee2d23f09e12 None admin] PATH_INFO: `/v3/users` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:31.656458 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40dabf9-9a14-4373-abfe-ee2d23f09e12 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:31.656765 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40dabf9-9a14-4373-abfe-ee2d23f09e12 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:31.658569 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40dabf9-9a14-4373-abfe-ee2d23f09e12 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:31.676167 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 291/571] 10.222.0.23 () {56 vars in 1139 bytes} [Thu Aug 18 19:28:31 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:31.676993 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40dabf9-9a14-4373-abfe-ee2d23f09e12 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:31.683928 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:31.740145 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:31.755248 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5a471d-77c7-435f-a522-53be30c59bf4 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:31.783400 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40dabf9-9a14-4373-abfe-ee2d23f09e12 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:31.792831 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47621228-e178-4a20-b4e1-42b5bd7a2c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:31.793461 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47621228-e178-4a20-b4e1-42b5bd7a2c52 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:31.793769 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47621228-e178-4a20-b4e1-42b5bd7a2c52 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:31.794042 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47621228-e178-4a20-b4e1-42b5bd7a2c52 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:31.800665 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47621228-e178-4a20-b4e1-42b5bd7a2c52 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:31.802136 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47621228-e178-4a20-b4e1-42b5bd7a2c52 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:31.814285 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application [None req-47621228-e178-4a20-b4e1-42b5bd7a2c52 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 19:28:31.814285 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:31.814285 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:31.814285 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:31.814285 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:31.814285 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:31.814285 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:31.814285 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:31.814285 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:31.814285 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:31.814285 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:31.814285 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:31.814285 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 19:28:31.814285 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 19:28:31.814285 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 19:28:31.815200 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 19:28:31.815200 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:31.815200 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:31.815200 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:31.815200 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:31.815200 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:31.815200 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:31.815200 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:31.815200 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:31.815200 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:31.815200 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:31.815200 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:31.815200 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:31.815200 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:31.815200 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:31.815200 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:31.815200 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:31.816934 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 19:28:31.816934 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 19:28:31.816934 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 19:28:31.816934 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 19:28:31.816934 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 19:28:31.816934 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 19:28:31.816934 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 19:28:31.816934 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:28:31.816934 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 281/572] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Aug 18 19:28:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:28:31.816934 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47621228-e178-4a20-b4e1-42b5bd7a2c52 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:31.824352 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0240eb-70f4-4bbb-8c6e-8bc0f3d50dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:31.824965 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0240eb-70f4-4bbb-8c6e-8bc0f3d50dd8 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:31.825246 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0240eb-70f4-4bbb-8c6e-8bc0f3d50dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:31.825516 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0240eb-70f4-4bbb-8c6e-8bc0f3d50dd8 None admin] PATH_INFO: `/v3/domains` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:31.826837 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0240eb-70f4-4bbb-8c6e-8bc0f3d50dd8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:31.827056 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0240eb-70f4-4bbb-8c6e-8bc0f3d50dd8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:31.828606 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0240eb-70f4-4bbb-8c6e-8bc0f3d50dd8 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:31.841281 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 292/573] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Aug 18 19:28:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:31.841281 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0240eb-70f4-4bbb-8c6e-8bc0f3d50dd8 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:31.924290 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47621228-e178-4a20-b4e1-42b5bd7a2c52 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:31.939135 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:31.944977 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0240eb-70f4-4bbb-8c6e-8bc0f3d50dd8 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:31.960853 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4bafee-26b8-4153-a4dd-05aa278bcbec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:31.961771 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4bafee-26b8-4153-a4dd-05aa278bcbec None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:31.962050 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4bafee-26b8-4153-a4dd-05aa278bcbec None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:31.962321 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4bafee-26b8-4153-a4dd-05aa278bcbec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:31.967905 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:31.972638 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4bafee-26b8-4153-a4dd-05aa278bcbec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:31.975381 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4bafee-26b8-4153-a4dd-05aa278bcbec None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:31.981617 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2700bf31-cf95-45f6-b552-33874e536efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:31.982786 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2700bf31-cf95-45f6-b552-33874e536efc None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:31.983060 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2700bf31-cf95-45f6-b552-33874e536efc None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:31.983330 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2700bf31-cf95-45f6-b552-33874e536efc None admin] PATH_INFO: `/v3/projects` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:31.984007 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2700bf31-cf95-45f6-b552-33874e536efc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:31.984309 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2700bf31-cf95-45f6-b552-33874e536efc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:31.985732 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2700bf31-cf95-45f6-b552-33874e536efc None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:31.990291 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application [None req-3f4bafee-26b8-4153-a4dd-05aa278bcbec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:28:31.990291 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:31.990291 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:31.990291 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:31.990291 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:31.990291 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:31.990291 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:31.990291 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:31.990291 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:31.990291 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:31.990291 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:31.990291 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:31.990291 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 19:28:31.990291 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 19:28:31.990291 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 19:28:31.990291 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 19:28:31.991182 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:31.991182 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:31.991182 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:31.991182 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:31.991182 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:31.991182 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:31.991182 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:31.991182 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:31.991182 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:31.991182 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:31.991182 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:31.991182 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:31.991182 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:31.991182 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:31.991182 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:31.991182 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:31.991182 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 19:28:31.992043 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 19:28:31.992043 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:28:31.992043 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:28:31.998513 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 293/575] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Aug 18 19:28:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:31.998681 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 282/575] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Aug 18 19:28:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:28:31.999318 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2700bf31-cf95-45f6-b552-33874e536efc None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:31.999873 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4bafee-26b8-4153-a4dd-05aa278bcbec None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:32.113466 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2700bf31-cf95-45f6-b552-33874e536efc None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:32.116622 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4bafee-26b8-4153-a4dd-05aa278bcbec None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:32.150594 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd1d8d0-8c3e-4fc5-9ee9-118175b214a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:32.151221 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd1d8d0-8c3e-4fc5-9ee9-118175b214a9 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:32.151498 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd1d8d0-8c3e-4fc5-9ee9-118175b214a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:32.151767 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd1d8d0-8c3e-4fc5-9ee9-118175b214a9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:32.152508 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecbdb6f-58f0-43ab-b7cf-28b97e1efa68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:32.153300 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecbdb6f-58f0-43ab-b7cf-28b97e1efa68 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:32.153818 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecbdb6f-58f0-43ab-b7cf-28b97e1efa68 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:32.154308 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecbdb6f-58f0-43ab-b7cf-28b97e1efa68 None admin] PATH_INFO: `/v3/domains` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:32.155107 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecbdb6f-58f0-43ab-b7cf-28b97e1efa68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:32.155628 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecbdb6f-58f0-43ab-b7cf-28b97e1efa68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:32.157164 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecbdb6f-58f0-43ab-b7cf-28b97e1efa68 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:32.158476 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd1d8d0-8c3e-4fc5-9ee9-118175b214a9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:32.159890 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd1d8d0-8c3e-4fc5-9ee9-118175b214a9 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:32.170513 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 283/576] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Aug 18 19:28:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:32.171509 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecbdb6f-58f0-43ab-b7cf-28b97e1efa68 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:32.172042 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application [None req-fcd1d8d0-8c3e-4fc5-9ee9-118175b214a9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 19:28:32.172042 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:32.172042 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:32.172042 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:32.172042 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:32.172042 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:32.172042 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:32.172042 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:32.172042 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:32.172042 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:32.172042 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:32.172042 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:32.172042 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 19:28:32.172042 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 19:28:32.172042 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 19:28:32.172899 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 19:28:32.172899 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:32.172899 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:32.172899 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:32.172899 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:32.172899 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:32.172899 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:32.172899 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:32.172899 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:32.172899 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:32.172899 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:32.172899 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:32.172899 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:32.172899 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:32.172899 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:32.172899 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:32.172899 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:32.177130 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 19:28:32.177130 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 19:28:32.177130 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 19:28:32.177130 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 19:28:32.177130 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 19:28:32.177130 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 19:28:32.177130 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 19:28:32.177130 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:28:32.177130 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 294/577] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Aug 18 19:28:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:28:32.179099 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd1d8d0-8c3e-4fc5-9ee9-118175b214a9 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:32.182269 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:32.230417 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:32.287890 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecbdb6f-58f0-43ab-b7cf-28b97e1efa68 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:32.291977 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd1d8d0-8c3e-4fc5-9ee9-118175b214a9 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:32.327106 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216a135d-96c5-43f8-b22b-2f78e44e98b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:32.327348 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7908bc2-b5c9-4a9d-8cc2-6a93a1807396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:32.327711 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216a135d-96c5-43f8-b22b-2f78e44e98b5 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:32.327816 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7908bc2-b5c9-4a9d-8cc2-6a93a1807396 None admin] REQUEST_METHOD: `PUT` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:32.327980 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216a135d-96c5-43f8-b22b-2f78e44e98b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:32.328087 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7908bc2-b5c9-4a9d-8cc2-6a93a1807396 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:32.328253 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216a135d-96c5-43f8-b22b-2f78e44e98b5 None admin] PATH_INFO: `/v3/projects` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:32.328344 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7908bc2-b5c9-4a9d-8cc2-6a93a1807396 None admin] PATH_INFO: `/v3/projects/a44b197c3aa0479092f4d77d2c791c39/users/62ab2be725844b49bde7941867d672d1/roles/2a89ce9253da431fb2d0bf1ff51e1426` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:32.328921 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216a135d-96c5-43f8-b22b-2f78e44e98b5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:32.329224 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216a135d-96c5-43f8-b22b-2f78e44e98b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:32.330689 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216a135d-96c5-43f8-b22b-2f78e44e98b5 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:32.345352 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 295/578] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Aug 18 19:28:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:28:32.346195 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216a135d-96c5-43f8-b22b-2f78e44e98b5 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:32.351014 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7908bc2-b5c9-4a9d-8cc2-6a93a1807396 None admin] RBAC: Authorizing `identity:create_grant(project_id=a44b197c3aa0479092f4d77d2c791c39, user_id=62ab2be725844b49bde7941867d672d1, role_id=2a89ce9253da431fb2d0bf1ff51e1426)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:32.352462 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7908bc2-b5c9-4a9d-8cc2-6a93a1807396 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:32.414466 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 284/579] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Aug 18 19:28:32 2022] PUT /identity/v3/projects/a44b197c3aa0479092f4d77d2c791c39/users/62ab2be725844b49bde7941867d672d1/roles/2a89ce9253da431fb2d0bf1ff51e1426 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 19:28:32.415270 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7908bc2-b5c9-4a9d-8cc2-6a93a1807396 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:32.460821 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:32.465480 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216a135d-96c5-43f8-b22b-2f78e44e98b5 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:32.508775 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b8c2b6-21a3-4c8e-b40b-7e673e0629b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:32.509545 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b8c2b6-21a3-4c8e-b40b-7e673e0629b7 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:32.509645 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b8c2b6-21a3-4c8e-b40b-7e673e0629b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:32.509912 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b8c2b6-21a3-4c8e-b40b-7e673e0629b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:32.514364 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:32.517812 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b8c2b6-21a3-4c8e-b40b-7e673e0629b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:32.519299 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b8c2b6-21a3-4c8e-b40b-7e673e0629b7 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:32.535018 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application [None req-63b8c2b6-21a3-4c8e-b40b-7e673e0629b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 19:28:32.535018 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:32.535018 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:32.535018 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:32.535018 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:32.535018 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:32.535018 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:32.535018 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:32.535018 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:32.535018 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:32.535018 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:32.535018 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:32.535018 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 19:28:32.535018 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 19:28:32.535018 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 19:28:32.535970 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 19:28:32.535970 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:32.535970 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:32.535970 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:32.535970 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:32.535970 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:32.535970 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:32.535970 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:32.535970 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:32.535970 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:32.535970 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:32.535970 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:32.535970 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:32.535970 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:32.535970 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:32.535970 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:32.535970 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:32.536959 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 19:28:32.536959 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 19:28:32.536959 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 19:28:32.536959 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 19:28:32.536959 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 19:28:32.536959 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 19:28:32.536959 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 19:28:32.536959 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:28:32.537399 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 296/580] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Aug 18 19:28:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:28:32.543734 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b8c2b6-21a3-4c8e-b40b-7e673e0629b7 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:32.585976 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7908bc2-b5c9-4a9d-8cc2-6a93a1807396 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:32.633162 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7362f5fd-87b7-489e-8c26-df0d467d66c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:32.633874 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7362f5fd-87b7-489e-8c26-df0d467d66c8 None admin] REQUEST_METHOD: `PUT` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:32.634212 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7362f5fd-87b7-489e-8c26-df0d467d66c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:32.634432 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7362f5fd-87b7-489e-8c26-df0d467d66c8 None admin] PATH_INFO: `/v3/projects/a44b197c3aa0479092f4d77d2c791c39/users/28c99ca9206340269f30be592fcd3f75/roles/2a89ce9253da431fb2d0bf1ff51e1426` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:32.652477 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7362f5fd-87b7-489e-8c26-df0d467d66c8 None admin] RBAC: Authorizing `identity:create_grant(project_id=a44b197c3aa0479092f4d77d2c791c39, user_id=28c99ca9206340269f30be592fcd3f75, role_id=2a89ce9253da431fb2d0bf1ff51e1426)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:32.654507 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7362f5fd-87b7-489e-8c26-df0d467d66c8 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:32.674884 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b8c2b6-21a3-4c8e-b40b-7e673e0629b7 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:32.711363 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71af124-e617-437e-b013-0150c16f8e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:32.712033 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71af124-e617-437e-b013-0150c16f8e17 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:32.712310 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71af124-e617-437e-b013-0150c16f8e17 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:32.712577 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71af124-e617-437e-b013-0150c16f8e17 None admin] PATH_INFO: `/v3/projects` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:32.713254 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71af124-e617-437e-b013-0150c16f8e17 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:32.713555 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71af124-e617-437e-b013-0150c16f8e17 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:32.715025 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71af124-e617-437e-b013-0150c16f8e17 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:32.727844 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 297/581] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Aug 18 19:28:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:32.733911 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71af124-e617-437e-b013-0150c16f8e17 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:32.755291 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:32.764308 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 285/582] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Aug 18 19:28:32 2022] PUT /identity/v3/projects/a44b197c3aa0479092f4d77d2c791c39/users/28c99ca9206340269f30be592fcd3f75/roles/2a89ce9253da431fb2d0bf1ff51e1426 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 19:28:32.859123 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71af124-e617-437e-b013-0150c16f8e17 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:32.897358 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa81b1ec-8f96-4285-b27c-0525333ebbee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:32.898077 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81b1ec-8f96-4285-b27c-0525333ebbee None admin] REQUEST_METHOD: `PUT` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:32.898359 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81b1ec-8f96-4285-b27c-0525333ebbee None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:32.898635 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81b1ec-8f96-4285-b27c-0525333ebbee None admin] PATH_INFO: `/v3/projects/a44b197c3aa0479092f4d77d2c791c39/users/516923ce386f459190af3fd7eaa81551/roles/2a89ce9253da431fb2d0bf1ff51e1426` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:32.915875 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa81b1ec-8f96-4285-b27c-0525333ebbee None admin] RBAC: Authorizing `identity:create_grant(project_id=a44b197c3aa0479092f4d77d2c791c39, user_id=516923ce386f459190af3fd7eaa81551, role_id=2a89ce9253da431fb2d0bf1ff51e1426)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:32.917350 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa81b1ec-8f96-4285-b27c-0525333ebbee None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:32.952357 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7b6cb7-3ad9-4ea6-8f31-a63c410ae9e0 None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:32.952884 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7b6cb7-3ad9-4ea6-8f31-a63c410ae9e0 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:32.952884 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7b6cb7-3ad9-4ea6-8f31-a63c410ae9e0 None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:32.954261 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 286/583] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:28:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:28:32.959754 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e456d6-048c-4828-a67e-a8ab2a2b1002 None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:32.960043 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e456d6-048c-4828-a67e-a8ab2a2b1002 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:32.960333 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e456d6-048c-4828-a67e-a8ab2a2b1002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:32.980108 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-e8e456d6-048c-4828-a67e-a8ab2a2b1002 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:28:32.981316 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-e8e456d6-048c-4828-a67e-a8ab2a2b1002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:28:33.007572 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 298/584] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Aug 18 19:28:32 2022] PUT /identity/v3/projects/a44b197c3aa0479092f4d77d2c791c39/users/516923ce386f459190af3fd7eaa81551/roles/2a89ce9253da431fb2d0bf1ff51e1426 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 19:28:33.083732 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 287/585] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:28:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:28:33.443466 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa81b1ec-8f96-4285-b27c-0525333ebbee None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:33.513919 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:33.548788 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa81b1ec-8f96-4285-b27c-0525333ebbee None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:33.584564 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8033f76a-78b6-41ea-a5eb-c97a30f2db51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:33.585335 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8033f76a-78b6-41ea-a5eb-c97a30f2db51 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:33.585697 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8033f76a-78b6-41ea-a5eb-c97a30f2db51 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:33.586288 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8033f76a-78b6-41ea-a5eb-c97a30f2db51 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:33.597760 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8033f76a-78b6-41ea-a5eb-c97a30f2db51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:28:33.602721 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application [None req-8033f76a-78b6-41ea-a5eb-c97a30f2db51 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 19:28:33.602721 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:33.602721 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:33.602721 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:33.602721 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:33.602721 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:33.602721 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:33.602721 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:33.602721 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:33.602721 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:33.602721 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:33.602721 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:33.602721 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:28:33.602721 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:28:33.602721 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:28:33.602721 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:28:33.603845 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:28:33.603845 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:28:33.603845 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:28:33.603845 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:28:33.603845 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:33.603845 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:33.603845 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:33.603845 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:33.603845 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:33.603845 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:33.603845 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:33.603845 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:33.603845 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:33.603845 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:33.603845 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:33.603845 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:33.604925 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:33.604925 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:33.604925 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:33.604925 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:33.604925 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:28:33.604925 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:28:33.604925 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:28:33.604925 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:28:33.604925 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:28:33.604925 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:28:33.604925 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 19:28:33.604925 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:28:33.611325 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 299/586] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Aug 18 19:28:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:28:33.612760 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e456d6-048c-4828-a67e-a8ab2a2b1002 None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:33.646498 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:33.720522 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e456d6-048c-4828-a67e-a8ab2a2b1002 None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:33.755911 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422d9ae7-2b20-499e-93bd-674017e495d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:33.756786 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422d9ae7-2b20-499e-93bd-674017e495d0 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:33.757170 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422d9ae7-2b20-499e-93bd-674017e495d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:33.757548 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422d9ae7-2b20-499e-93bd-674017e495d0 None admin] PATH_INFO: `/v3/roles` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:33.758328 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422d9ae7-2b20-499e-93bd-674017e495d0 None admin] RBAC: Adding query filter params (name=service) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:33.758731 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422d9ae7-2b20-499e-93bd-674017e495d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:33.760199 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422d9ae7-2b20-499e-93bd-674017e495d0 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:33.773769 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 288/587] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Aug 18 19:28:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:33.775532 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8033f76a-78b6-41ea-a5eb-c97a30f2db51 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:33.881758 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8033f76a-78b6-41ea-a5eb-c97a30f2db51 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:33.910864 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:33.918569 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e0b0c2-64cf-4c93-b0ca-cf67f89f3c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:33.919345 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e0b0c2-64cf-4c93-b0ca-cf67f89f3c58 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:33.919726 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e0b0c2-64cf-4c93-b0ca-cf67f89f3c58 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:33.920101 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e0b0c2-64cf-4c93-b0ca-cf67f89f3c58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:33.930505 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e0b0c2-64cf-4c93-b0ca-cf67f89f3c58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:33.932120 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e0b0c2-64cf-4c93-b0ca-cf67f89f3c58 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:33.947884 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application [None req-e7e0b0c2-64cf-4c93-b0ca-cf67f89f3c58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:28:33.947884 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:33.947884 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:33.947884 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:33.947884 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:33.947884 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:33.947884 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:33.947884 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:33.947884 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:33.947884 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:33.947884 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:33.947884 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:33.947884 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 19:28:33.947884 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 19:28:33.947884 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 19:28:33.947884 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 19:28:33.949122 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:33.949122 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:33.949122 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:33.949122 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:33.949122 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:33.949122 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:33.949122 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:33.949122 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:33.949122 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:33.949122 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:33.949122 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:33.949122 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:33.949122 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:33.949122 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:33.949122 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:33.949122 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:33.949122 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 19:28:33.950237 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 19:28:33.950237 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:28:33.950237 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:28:33.956345 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 300/588] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Aug 18 19:28:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:28:33.957780 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422d9ae7-2b20-499e-93bd-674017e495d0 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:34.056434 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:34.072851 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422d9ae7-2b20-499e-93bd-674017e495d0 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:34.109420 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d9f693-97bd-451c-8ea5-2edccbbfed9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:34.110063 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d9f693-97bd-451c-8ea5-2edccbbfed9a None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:34.110346 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d9f693-97bd-451c-8ea5-2edccbbfed9a None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:34.110621 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d9f693-97bd-451c-8ea5-2edccbbfed9a None admin] PATH_INFO: `/v3/domains` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:34.111260 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d9f693-97bd-451c-8ea5-2edccbbfed9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:34.111565 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d9f693-97bd-451c-8ea5-2edccbbfed9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:34.112934 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d9f693-97bd-451c-8ea5-2edccbbfed9a None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:34.129797 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 289/589] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Aug 18 19:28:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:34.131916 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e0b0c2-64cf-4c93-b0ca-cf67f89f3c58 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:34.241060 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e0b0c2-64cf-4c93-b0ca-cf67f89f3c58 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:34.276487 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6309745-a566-4d61-927c-5b4ff6d3ecb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:34.277130 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6309745-a566-4d61-927c-5b4ff6d3ecb2 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:34.277413 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6309745-a566-4d61-927c-5b4ff6d3ecb2 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:34.277767 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6309745-a566-4d61-927c-5b4ff6d3ecb2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:34.285545 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6309745-a566-4d61-927c-5b4ff6d3ecb2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:34.287021 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6309745-a566-4d61-927c-5b4ff6d3ecb2 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:34.298900 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application [None req-f6309745-a566-4d61-927c-5b4ff6d3ecb2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 18 19:28:34.298900 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:34.298900 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:34.298900 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:34.298900 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:34.298900 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:34.298900 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:34.298900 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:34.298900 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:34.298900 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:34.298900 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:34.298900 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:34.298900 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 19:28:34.298900 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 19:28:34.298900 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 19:28:34.298900 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 19:28:34.299858 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:34.299858 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:34.299858 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 19:28:34.299858 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 19:28:34.299858 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 19:28:34.299858 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 19:28:34.299858 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:34.299858 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:34.299858 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:34.299858 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:34.299858 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:34.299858 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:34.299858 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:34.299858 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:34.299858 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:34.299858 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:34.299858 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:34.299858 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:34.300820 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:34.300820 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:34.300820 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 19:28:34.300820 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 19:28:34.300820 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 19:28:34.300820 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 19:28:34.300820 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 19:28:34.300820 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 19:28:34.300820 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 18 19:28:34.300820 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:28:34.304699 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 301/590] 10.222.0.23 () {56 vars in 1093 bytes} [Thu Aug 18 19:28:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:28:34.306115 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d9f693-97bd-451c-8ea5-2edccbbfed9a None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:34.411339 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d9f693-97bd-451c-8ea5-2edccbbfed9a None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:34.447098 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3055e2-d341-4df2-9448-ca25260ad554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:34.448080 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3055e2-d341-4df2-9448-ca25260ad554 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:34.448573 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3055e2-d341-4df2-9448-ca25260ad554 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:34.449038 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3055e2-d341-4df2-9448-ca25260ad554 None admin] PATH_INFO: `/v3/users` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:34.449987 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3055e2-d341-4df2-9448-ca25260ad554 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:34.450523 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3055e2-d341-4df2-9448-ca25260ad554 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:34.452141 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3055e2-d341-4df2-9448-ca25260ad554 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:34.470521 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 290/591] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Aug 18 19:28:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:34.478525 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6309745-a566-4d61-927c-5b4ff6d3ecb2 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:34.520519 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:34.582019 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6309745-a566-4d61-927c-5b4ff6d3ecb2 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:34.617903 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d77ea3-1820-4b8d-86f9-681f20d8fc7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:34.618525 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d77ea3-1820-4b8d-86f9-681f20d8fc7f None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:34.618805 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d77ea3-1820-4b8d-86f9-681f20d8fc7f None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:34.619081 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d77ea3-1820-4b8d-86f9-681f20d8fc7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:34.694632 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d77ea3-1820-4b8d-86f9-681f20d8fc7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:34.696025 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d77ea3-1820-4b8d-86f9-681f20d8fc7f None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:34.742015 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:34.801844 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9e7ecd-f55a-45c9-8892-adf99f5ebcd3 None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:34.802186 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9e7ecd-f55a-45c9-8892-adf99f5ebcd3 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:34.802393 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9e7ecd-f55a-45c9-8892-adf99f5ebcd3 None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:34.804028 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 291/593] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:28:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 19:28:34.807467 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 302/593] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Aug 18 19:28:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 19:28:34.808890 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9e7ecd-f55a-45c9-8892-adf99f5ebcd3 None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:34.811357 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c726df82-82e7-4544-a442-9de47399d7b3 None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:34.811645 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c726df82-82e7-4544-a442-9de47399d7b3 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:34.811926 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c726df82-82e7-4544-a442-9de47399d7b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:34.832749 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-c726df82-82e7-4544-a442-9de47399d7b3 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:28:34.837879 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:34.837991 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-c726df82-82e7-4544-a442-9de47399d7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:28:34.909872 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 303/594] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:28:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 19:28:34.938242 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9e7ecd-f55a-45c9-8892-adf99f5ebcd3 None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:34.965469 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45030ab-7cbb-41d4-9c5f-43fee912e163 None None] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:34.965819 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45030ab-7cbb-41d4-9c5f-43fee912e163 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:34.966047 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45030ab-7cbb-41d4-9c5f-43fee912e163 None None] PATH_INFO: `/` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:34.968321 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 304/595] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:28:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 19:28:34.972998 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6117596-1f23-423c-92dc-c65c65bfd0fe None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:34.973278 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6117596-1f23-423c-92dc-c65c65bfd0fe None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:34.973550 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6117596-1f23-423c-92dc-c65c65bfd0fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:34.984868 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215a48d5-1f50-4908-8b0e-e5b449578dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:34.986271 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a48d5-1f50-4908-8b0e-e5b449578dec None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:34.986760 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a48d5-1f50-4908-8b0e-e5b449578dec None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:34.987237 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a48d5-1f50-4908-8b0e-e5b449578dec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:34.992207 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-a6117596-1f23-423c-92dc-c65c65bfd0fe None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:28:34.999290 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-a6117596-1f23-423c-92dc-c65c65bfd0fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:28:34.999400 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215a48d5-1f50-4908-8b0e-e5b449578dec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:35.001039 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215a48d5-1f50-4908-8b0e-e5b449578dec None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:35.019165 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application [None req-215a48d5-1f50-4908-8b0e-e5b449578dec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:28:35.019165 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:35.019165 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:35.019165 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:35.019165 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:35.019165 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:35.019165 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:35.019165 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:35.019165 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:35.019165 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:35.019165 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:35.019165 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:35.019165 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 19:28:35.019165 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 19:28:35.019165 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 19:28:35.019165 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 19:28:35.020147 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:35.020147 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:35.020147 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:35.020147 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:35.020147 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:35.020147 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:35.020147 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:35.020147 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:35.020147 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:35.020147 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:35.020147 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:35.020147 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:35.020147 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:35.020147 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:35.020147 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:35.020147 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:35.020147 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 19:28:35.021019 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 19:28:35.021019 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:28:35.021019 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:28:35.022873 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 292/596] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Aug 18 19:28:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:28:35.029917 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215a48d5-1f50-4908-8b0e-e5b449578dec None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:35.082444 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:35.090893 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 305/597] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:28:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:28:35.121527 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:35.164406 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215a48d5-1f50-4908-8b0e-e5b449578dec None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:35.199807 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdc45d7-a7e9-4351-b774-74dbc23eb9f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:35.201067 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc45d7-a7e9-4351-b774-74dbc23eb9f5 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:35.201394 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc45d7-a7e9-4351-b774-74dbc23eb9f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:35.201776 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc45d7-a7e9-4351-b774-74dbc23eb9f5 None admin] PATH_INFO: `/v3/domains` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:35.202438 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdc45d7-a7e9-4351-b774-74dbc23eb9f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:35.202745 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdc45d7-a7e9-4351-b774-74dbc23eb9f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:35.204164 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdc45d7-a7e9-4351-b774-74dbc23eb9f5 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:35.224345 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 293/598] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Aug 18 19:28:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:35.225826 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6117596-1f23-423c-92dc-c65c65bfd0fe None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:35.253633 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdc45d7-a7e9-4351-b774-74dbc23eb9f5 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:35.346756 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6117596-1f23-423c-92dc-c65c65bfd0fe None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:35.383272 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58243646-7ee1-4308-9ea3-d1fd53d0f97d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:35.383899 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58243646-7ee1-4308-9ea3-d1fd53d0f97d None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:35.384035 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdc45d7-a7e9-4351-b774-74dbc23eb9f5 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:35.384220 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58243646-7ee1-4308-9ea3-d1fd53d0f97d None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:35.384438 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58243646-7ee1-4308-9ea3-d1fd53d0f97d None admin] PATH_INFO: `/v3/projects/service` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:35.391968 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58243646-7ee1-4308-9ea3-d1fd53d0f97d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:35.393425 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58243646-7ee1-4308-9ea3-d1fd53d0f97d None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:35.405197 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application [None req-58243646-7ee1-4308-9ea3-d1fd53d0f97d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 19:28:35.405197 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:35.405197 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:35.405197 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:35.405197 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:35.405197 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:35.405197 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:35.405197 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:35.405197 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:35.405197 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:35.405197 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:35.405197 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:35.405197 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 19:28:35.405197 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 19:28:35.405197 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 19:28:35.406090 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 19:28:35.406090 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:35.406090 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:35.406090 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:35.406090 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:35.406090 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:35.406090 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:35.406090 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:35.406090 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:35.406090 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:35.406090 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:35.406090 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:35.406090 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:35.406090 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:35.406090 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:35.406090 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:35.406090 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:35.406962 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 19:28:35.406962 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 19:28:35.406962 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 19:28:35.406962 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 19:28:35.406962 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 19:28:35.406962 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 19:28:35.406962 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 19:28:35.406962 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:28:35.406962 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 306/599] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Aug 18 19:28:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:28:35.407434 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9ff1bf-df5e-4ff1-be8d-a6340d012cd7 None None] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:35.408319 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9ff1bf-df5e-4ff1-be8d-a6340d012cd7 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:35.408319 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9ff1bf-df5e-4ff1-be8d-a6340d012cd7 None None] PATH_INFO: `/` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:35.409313 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 307/600] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:28:35 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:28:35.413455 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:35.413903 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9ff1bf-df5e-4ff1-be8d-a6340d012cd7 None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:35.423907 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd191a7-b62b-419b-892d-6042f3904765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:35.424530 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd191a7-b62b-419b-892d-6042f3904765 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:35.424806 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd191a7-b62b-419b-892d-6042f3904765 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:35.425086 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd191a7-b62b-419b-892d-6042f3904765 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:35.435527 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd191a7-b62b-419b-892d-6042f3904765 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:28:35.440184 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application [None req-ecd191a7-b62b-419b-892d-6042f3904765 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 19:28:35.440184 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:35.440184 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:35.440184 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:35.440184 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:35.440184 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:35.440184 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:35.440184 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:35.440184 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:35.440184 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:35.440184 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:35.440184 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:35.440184 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:28:35.440184 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:28:35.440184 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:28:35.440184 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:28:35.441322 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:28:35.441322 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:28:35.441322 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:28:35.441322 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:28:35.441322 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:35.441322 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:35.441322 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:35.441322 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:35.441322 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:35.441322 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:35.441322 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:35.441322 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:35.441322 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:35.441322 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:35.441322 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:35.441322 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:35.442240 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:35.442240 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:35.442240 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:35.442240 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:35.442240 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:28:35.442240 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:28:35.442240 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:28:35.442240 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:28:35.442240 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:28:35.442240 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:28:35.442240 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 19:28:35.442240 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:28:35.442240 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 294/601] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Aug 18 19:28:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 19:28:35.442933 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7731009e-9542-4567-843e-688e211f9e0b None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:35.443141 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7731009e-9542-4567-843e-688e211f9e0b None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:35.443422 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7731009e-9542-4567-843e-688e211f9e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:35.461534 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-7731009e-9542-4567-843e-688e211f9e0b None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:28:35.462738 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-7731009e-9542-4567-843e-688e211f9e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:28:35.479204 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:35.520917 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9ff1bf-df5e-4ff1-be8d-a6340d012cd7 None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:35.530185 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 295/602] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:28:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:28:35.530858 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7731009e-9542-4567-843e-688e211f9e0b None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:35.558795 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a45ffd-b799-4b27-8bc2-02ea9c7f7d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:35.559405 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a45ffd-b799-4b27-8bc2-02ea9c7f7d13 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:35.560222 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a45ffd-b799-4b27-8bc2-02ea9c7f7d13 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:35.560501 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a45ffd-b799-4b27-8bc2-02ea9c7f7d13 None admin] PATH_INFO: `/v3/projects` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:35.561181 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a45ffd-b799-4b27-8bc2-02ea9c7f7d13 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:35.561480 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a45ffd-b799-4b27-8bc2-02ea9c7f7d13 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:35.562925 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a45ffd-b799-4b27-8bc2-02ea9c7f7d13 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:35.574430 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 308/603] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Aug 18 19:28:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:35.575993 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a45ffd-b799-4b27-8bc2-02ea9c7f7d13 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:35.642089 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7731009e-9542-4567-843e-688e211f9e0b None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:35.656400 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:35.676951 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a45ffd-b799-4b27-8bc2-02ea9c7f7d13 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:35.678467 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ca2a28-4c37-4606-9743-75dfb079a052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:35.679209 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ca2a28-4c37-4606-9743-75dfb079a052 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:35.679489 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ca2a28-4c37-4606-9743-75dfb079a052 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:35.679760 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ca2a28-4c37-4606-9743-75dfb079a052 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:35.692012 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ca2a28-4c37-4606-9743-75dfb079a052 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:28:35.696979 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application [None req-04ca2a28-4c37-4606-9743-75dfb079a052 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 19:28:35.696979 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:35.696979 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:35.696979 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:35.696979 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:35.696979 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:35.696979 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:35.696979 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:35.696979 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:35.696979 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:35.696979 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:35.696979 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:35.696979 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:28:35.696979 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:28:35.696979 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:28:35.696979 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:28:35.697928 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:28:35.697928 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:28:35.697928 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:28:35.697928 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:28:35.697928 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:35.697928 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:35.697928 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:35.697928 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:35.697928 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:35.697928 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:35.697928 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:35.697928 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:35.697928 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:35.697928 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:35.697928 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:35.697928 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:35.698755 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:35.698755 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:35.698755 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:35.698755 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:35.698755 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:28:35.698755 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:28:35.698755 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:28:35.698755 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:28:35.698755 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:28:35.698755 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:28:35.698755 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 19:28:35.698755 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:28:35.699398 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:35.699468 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 296/604] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Aug 18 19:28:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:28:35.700064 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ca2a28-4c37-4606-9743-75dfb079a052 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:35.719208 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdd6244-36fc-46b1-8323-e0f3bb65ad12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:35.719892 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdd6244-36fc-46b1-8323-e0f3bb65ad12 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:35.720173 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdd6244-36fc-46b1-8323-e0f3bb65ad12 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:35.720448 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdd6244-36fc-46b1-8323-e0f3bb65ad12 None admin] PATH_INFO: `/v3/roles` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:35.721105 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdd6244-36fc-46b1-8323-e0f3bb65ad12 None admin] RBAC: Adding query filter params (name=service) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:35.721405 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdd6244-36fc-46b1-8323-e0f3bb65ad12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:35.722808 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdd6244-36fc-46b1-8323-e0f3bb65ad12 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:35.733125 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 309/605] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Aug 18 19:28:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:35.733787 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdd6244-36fc-46b1-8323-e0f3bb65ad12 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:35.811337 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ca2a28-4c37-4606-9743-75dfb079a052 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:35.844964 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdd6244-36fc-46b1-8323-e0f3bb65ad12 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:35.849245 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705affea-d1dd-4d96-9773-a84a024338d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:35.849910 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705affea-d1dd-4d96-9773-a84a024338d3 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:35.850184 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705affea-d1dd-4d96-9773-a84a024338d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:35.850490 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705affea-d1dd-4d96-9773-a84a024338d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:35.851654 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705affea-d1dd-4d96-9773-a84a024338d3 None admin] RBAC: Adding query filter params (role.id=2a89ce9253da431fb2d0bf1ff51e1426, scope.project.id=a44b197c3aa0479092f4d77d2c791c39, user.id=9c3560e900d248bc93147ddce515365b) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:35.851986 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705affea-d1dd-4d96-9773-a84a024338d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:35.853459 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705affea-d1dd-4d96-9773-a84a024338d3 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:35.860498 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 297/606] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Aug 18 19:28:35 2022] GET /identity/v3/role_assignments?user.id=9c3560e900d248bc93147ddce515365b&scope.project.id=a44b197c3aa0479092f4d77d2c791c39&role.id=2a89ce9253da431fb2d0bf1ff51e1426 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:35.861292 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705affea-d1dd-4d96-9773-a84a024338d3 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:35.883204 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d759a328-a4a6-4009-999e-2f99091be974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:35.884246 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d759a328-a4a6-4009-999e-2f99091be974 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:35.884733 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d759a328-a4a6-4009-999e-2f99091be974 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:35.885010 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d759a328-a4a6-4009-999e-2f99091be974 None admin] PATH_INFO: `/v3/roles` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:35.885738 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d759a328-a4a6-4009-999e-2f99091be974 None admin] RBAC: Adding query filter params (name=service) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:35.886063 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d759a328-a4a6-4009-999e-2f99091be974 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:35.887476 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d759a328-a4a6-4009-999e-2f99091be974 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:35.897124 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 310/607] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Aug 18 19:28:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:35.898044 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d759a328-a4a6-4009-999e-2f99091be974 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:35.916292 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:35.952226 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:35.987001 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705affea-d1dd-4d96-9773-a84a024338d3 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:36.012840 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d759a328-a4a6-4009-999e-2f99091be974 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:36.025330 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee63228-33b8-4430-8f3b-a1a2f6626111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:36.026274 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee63228-33b8-4430-8f3b-a1a2f6626111 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:36.026558 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee63228-33b8-4430-8f3b-a1a2f6626111 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:36.026832 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee63228-33b8-4430-8f3b-a1a2f6626111 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:36.039249 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee63228-33b8-4430-8f3b-a1a2f6626111 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:36.040794 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee63228-33b8-4430-8f3b-a1a2f6626111 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:36.057719 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application [None req-2ee63228-33b8-4430-8f3b-a1a2f6626111 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:28:36.057719 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:36.057719 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:36.057719 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:36.057719 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:36.057719 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:36.057719 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:36.057719 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:36.057719 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:36.057719 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:36.057719 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:36.057719 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:36.057719 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 19:28:36.057719 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 19:28:36.057719 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 19:28:36.057719 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 19:28:36.063692 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:36.063692 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:36.063692 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:36.063692 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:36.063692 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:36.063692 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:36.063692 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:36.063692 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:36.063692 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:36.063692 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:36.063692 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:36.063692 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:36.063692 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:36.063692 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:36.063692 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:36.063692 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:36.063692 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 19:28:36.064571 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 19:28:36.064571 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:28:36.064571 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:28:36.064571 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 298/608] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Aug 18 19:28:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:28:36.064812 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acfa29f-34c0-411e-8a14-e471f2b72eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:36.064903 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee63228-33b8-4430-8f3b-a1a2f6626111 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:36.064972 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acfa29f-34c0-411e-8a14-e471f2b72eaf None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:36.064972 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acfa29f-34c0-411e-8a14-e471f2b72eaf None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:36.064972 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acfa29f-34c0-411e-8a14-e471f2b72eaf None admin] PATH_INFO: `/v3/roles/service` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:36.081189 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acfa29f-34c0-411e-8a14-e471f2b72eaf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:28:36.086876 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application [None req-9acfa29f-34c0-411e-8a14-e471f2b72eaf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 19:28:36.086876 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:36.086876 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:36.086876 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:36.086876 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:36.086876 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:36.086876 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:36.086876 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:36.086876 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:36.086876 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:36.086876 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:36.086876 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:36.086876 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:28:36.086876 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:28:36.086876 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:28:36.086876 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:28:36.088052 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:28:36.088052 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:28:36.088052 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:28:36.088052 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:28:36.088052 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:36.088052 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:36.088052 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:36.088052 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:36.088052 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:36.088052 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:36.088052 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:36.088052 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:36.088052 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:36.088052 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:36.088052 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:36.088052 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:36.088877 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:36.088877 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:36.088877 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:36.088877 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:36.088877 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:28:36.088877 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:28:36.088877 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:28:36.088877 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:28:36.088877 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:28:36.088877 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:28:36.088877 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 19:28:36.088877 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:28:36.088877 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 311/609] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Aug 18 19:28:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:28:36.088877 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acfa29f-34c0-411e-8a14-e471f2b72eaf None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:36.170073 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:36.179372 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee63228-33b8-4430-8f3b-a1a2f6626111 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:36.212881 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346b4ca5-1f18-4128-b111-e1b54f73cd04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:36.214076 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346b4ca5-1f18-4128-b111-e1b54f73cd04 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:36.215195 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346b4ca5-1f18-4128-b111-e1b54f73cd04 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:36.215474 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346b4ca5-1f18-4128-b111-e1b54f73cd04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:36.221128 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acfa29f-34c0-411e-8a14-e471f2b72eaf None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:36.225429 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:36.226992 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346b4ca5-1f18-4128-b111-e1b54f73cd04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:36.228524 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346b4ca5-1f18-4128-b111-e1b54f73cd04 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:36.247687 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application [None req-346b4ca5-1f18-4128-b111-e1b54f73cd04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:28:36.247687 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:36.247687 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:36.247687 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:36.247687 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:36.247687 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:36.247687 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:36.247687 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:36.247687 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:36.247687 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:36.247687 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:36.247687 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:36.247687 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 19:28:36.247687 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 19:28:36.247687 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 19:28:36.247687 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 19:28:36.248662 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:36.248662 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:36.248662 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:36.248662 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:36.248662 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:36.248662 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:36.248662 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:36.248662 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:36.248662 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:36.248662 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:36.248662 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:36.248662 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:36.248662 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:36.248662 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:36.248662 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:36.248662 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:36.248662 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 19:28:36.254799 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 19:28:36.254799 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:28:36.254799 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:28:36.254799 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 299/610] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Aug 18 19:28:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:28:36.254799 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346b4ca5-1f18-4128-b111-e1b54f73cd04 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:36.262552 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ea85d0-caef-4311-86ee-0d2976237af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:36.263772 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea85d0-caef-4311-86ee-0d2976237af7 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:36.263999 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea85d0-caef-4311-86ee-0d2976237af7 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:36.264265 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea85d0-caef-4311-86ee-0d2976237af7 None admin] PATH_INFO: `/v3/domains` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:36.264899 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ea85d0-caef-4311-86ee-0d2976237af7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:36.265288 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ea85d0-caef-4311-86ee-0d2976237af7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:36.266584 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ea85d0-caef-4311-86ee-0d2976237af7 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:36.278906 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 312/611] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Aug 18 19:28:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:36.279733 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ea85d0-caef-4311-86ee-0d2976237af7 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:36.355720 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346b4ca5-1f18-4128-b111-e1b54f73cd04 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:36.388538 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ea85d0-caef-4311-86ee-0d2976237af7 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:36.392875 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b788ae2c-9788-4522-b433-a3e49148ca4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:36.393480 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b788ae2c-9788-4522-b433-a3e49148ca4c None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:36.393788 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b788ae2c-9788-4522-b433-a3e49148ca4c None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:36.394059 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b788ae2c-9788-4522-b433-a3e49148ca4c None admin] PATH_INFO: `/v3/roles` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:36.394712 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b788ae2c-9788-4522-b433-a3e49148ca4c None admin] RBAC: Adding query filter params (name=service) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:36.395012 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b788ae2c-9788-4522-b433-a3e49148ca4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:36.396420 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b788ae2c-9788-4522-b433-a3e49148ca4c None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:36.409529 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 300/612] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Aug 18 19:28:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:36.409529 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b788ae2c-9788-4522-b433-a3e49148ca4c None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:36.411489 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:36.430676 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9fd21c-4e2f-427d-b142-cd3875e1ce28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:36.431293 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9fd21c-4e2f-427d-b142-cd3875e1ce28 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:36.431572 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9fd21c-4e2f-427d-b142-cd3875e1ce28 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:36.431844 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9fd21c-4e2f-427d-b142-cd3875e1ce28 None admin] PATH_INFO: `/v3/domains` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:36.432534 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9fd21c-4e2f-427d-b142-cd3875e1ce28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:36.432850 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9fd21c-4e2f-427d-b142-cd3875e1ce28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:36.434416 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9fd21c-4e2f-427d-b142-cd3875e1ce28 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:36.451789 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 313/613] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Aug 18 19:28:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:36.451789 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9fd21c-4e2f-427d-b142-cd3875e1ce28 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:36.475075 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:36.525161 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b788ae2c-9788-4522-b433-a3e49148ca4c None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:36.553950 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9fd21c-4e2f-427d-b142-cd3875e1ce28 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:36.562947 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1789a6b-a6fc-483a-8147-de8ec3609cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:36.563571 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1789a6b-a6fc-483a-8147-de8ec3609cdd None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:36.563849 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1789a6b-a6fc-483a-8147-de8ec3609cdd None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:36.564117 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1789a6b-a6fc-483a-8147-de8ec3609cdd None admin] PATH_INFO: `/v3/users/glance` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:36.572956 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1789a6b-a6fc-483a-8147-de8ec3609cdd None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:36.574433 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1789a6b-a6fc-483a-8147-de8ec3609cdd None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:36.586797 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application [None req-c1789a6b-a6fc-483a-8147-de8ec3609cdd None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 18 19:28:36.586797 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:36.586797 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:36.586797 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:36.586797 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:36.586797 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:36.586797 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:36.586797 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:36.586797 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:36.586797 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:36.586797 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:36.586797 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:36.586797 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 19:28:36.586797 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 19:28:36.586797 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 19:28:36.586797 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 19:28:36.587895 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:36.587895 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:36.587895 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 19:28:36.587895 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 19:28:36.587895 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 19:28:36.587895 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 19:28:36.587895 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:36.587895 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:36.587895 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:36.587895 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:36.587895 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:36.587895 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:36.587895 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:36.587895 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:36.587895 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:36.587895 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:36.587895 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:36.587895 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:36.588823 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:36.588823 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:36.588823 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 19:28:36.588823 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 19:28:36.588823 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 19:28:36.588823 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 19:28:36.588823 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 19:28:36.588823 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 19:28:36.588823 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 18 19:28:36.588823 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:28:36.588823 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 301/614] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Aug 18 19:28:36 2022] GET /identity/v3/users/glance => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:28:36.589408 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1789a6b-a6fc-483a-8147-de8ec3609cdd None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:36.594680 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1858d738-c45d-4109-bba0-ee276cfd1489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:36.595414 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1858d738-c45d-4109-bba0-ee276cfd1489 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:36.595787 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1858d738-c45d-4109-bba0-ee276cfd1489 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:36.596151 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1858d738-c45d-4109-bba0-ee276cfd1489 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:36.607225 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1858d738-c45d-4109-bba0-ee276cfd1489 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:36.608746 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1858d738-c45d-4109-bba0-ee276cfd1489 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:36.623667 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application [None req-1858d738-c45d-4109-bba0-ee276cfd1489 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:28:36.623667 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:36.623667 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:36.623667 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:36.623667 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:36.623667 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:36.623667 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:36.623667 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:36.623667 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:36.623667 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:36.623667 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:36.623667 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:36.623667 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 19:28:36.623667 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 19:28:36.623667 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 19:28:36.623667 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 19:28:36.624813 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:36.624813 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:36.624813 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:36.624813 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:36.624813 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:36.624813 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:36.624813 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:36.624813 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:36.624813 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:36.624813 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:36.624813 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:36.624813 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:36.624813 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:36.624813 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:36.624813 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:36.624813 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:36.624813 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 19:28:36.625970 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 19:28:36.625970 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:28:36.625970 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:28:36.629389 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 314/615] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Aug 18 19:28:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:28:36.630277 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1858d738-c45d-4109-bba0-ee276cfd1489 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:36.660903 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:36.703970 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1789a6b-a6fc-483a-8147-de8ec3609cdd None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:36.713113 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:36.739373 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1858d738-c45d-4109-bba0-ee276cfd1489 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:36.740487 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5e6a48-9f00-4a03-9a7c-80676e3785ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:36.741110 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5e6a48-9f00-4a03-9a7c-80676e3785ff None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:36.741386 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5e6a48-9f00-4a03-9a7c-80676e3785ff None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:36.741744 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5e6a48-9f00-4a03-9a7c-80676e3785ff None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:36.750475 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5e6a48-9f00-4a03-9a7c-80676e3785ff None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:36.752131 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5e6a48-9f00-4a03-9a7c-80676e3785ff None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:36.763565 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application [None req-fb5e6a48-9f00-4a03-9a7c-80676e3785ff None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 18 19:28:36.763565 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:36.763565 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:36.763565 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:36.763565 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:36.763565 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:36.763565 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:36.763565 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:36.763565 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:36.763565 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:36.763565 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:36.763565 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:36.763565 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 19:28:36.763565 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 19:28:36.763565 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 19:28:36.763565 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 19:28:36.764697 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:36.764697 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:36.764697 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 19:28:36.764697 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 19:28:36.764697 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 19:28:36.764697 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 19:28:36.764697 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:36.764697 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:36.764697 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:36.764697 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:36.764697 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:36.764697 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:36.764697 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:36.764697 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:36.764697 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:36.764697 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:36.764697 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:36.764697 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:36.765631 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:36.765631 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:36.765631 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 19:28:36.765631 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 19:28:36.765631 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 19:28:36.765631 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 19:28:36.765631 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 19:28:36.765631 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 19:28:36.765631 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 18 19:28:36.765631 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:28:36.765631 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 302/616] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Aug 18 19:28:36 2022] GET /identity/v3/users/cinder => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:28:36.766255 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5e6a48-9f00-4a03-9a7c-80676e3785ff None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:36.782561 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81559099-9fd8-4ed0-9289-5def15186b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:36.783345 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81559099-9fd8-4ed0-9289-5def15186b2c None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:36.783797 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81559099-9fd8-4ed0-9289-5def15186b2c None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:36.784308 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81559099-9fd8-4ed0-9289-5def15186b2c None admin] PATH_INFO: `/v3/users` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:36.785285 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81559099-9fd8-4ed0-9289-5def15186b2c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:36.785843 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81559099-9fd8-4ed0-9289-5def15186b2c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:36.787402 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81559099-9fd8-4ed0-9289-5def15186b2c None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:36.807339 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 315/617] 10.222.0.23 () {56 vars in 1137 bytes} [Thu Aug 18 19:28:36 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:36.808407 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81559099-9fd8-4ed0-9289-5def15186b2c None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:36.870615 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5e6a48-9f00-4a03-9a7c-80676e3785ff None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:36.895091 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:36.906476 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d07a92-d1ba-462d-bd2e-803d14c7f76f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:36.907078 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d07a92-d1ba-462d-bd2e-803d14c7f76f None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:36.907357 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d07a92-d1ba-462d-bd2e-803d14c7f76f None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:36.907628 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d07a92-d1ba-462d-bd2e-803d14c7f76f None admin] PATH_INFO: `/v3/domains` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:36.908255 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d07a92-d1ba-462d-bd2e-803d14c7f76f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:36.908555 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d07a92-d1ba-462d-bd2e-803d14c7f76f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:36.909937 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d07a92-d1ba-462d-bd2e-803d14c7f76f None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:36.926384 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 303/618] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Aug 18 19:28:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:36.926384 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d07a92-d1ba-462d-bd2e-803d14c7f76f None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:36.926622 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81559099-9fd8-4ed0-9289-5def15186b2c None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:36.963868 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970f95aa-1a40-469b-8c9b-142d47257cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:36.964563 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f95aa-1a40-469b-8c9b-142d47257cec None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:36.964901 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f95aa-1a40-469b-8c9b-142d47257cec None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:36.965173 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f95aa-1a40-469b-8c9b-142d47257cec None admin] PATH_INFO: `/v3/users` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:36.966438 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970f95aa-1a40-469b-8c9b-142d47257cec None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:36.966745 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970f95aa-1a40-469b-8c9b-142d47257cec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:36.968155 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970f95aa-1a40-469b-8c9b-142d47257cec None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:36.969831 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:36.986447 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 316/619] 10.222.0.23 () {56 vars in 1137 bytes} [Thu Aug 18 19:28:36 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:36.987370 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970f95aa-1a40-469b-8c9b-142d47257cec None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:37.039269 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d07a92-d1ba-462d-bd2e-803d14c7f76f None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:37.079480 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47921998-b331-41d9-ae3e-a8b582da56cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:37.080094 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47921998-b331-41d9-ae3e-a8b582da56cc None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:37.080374 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47921998-b331-41d9-ae3e-a8b582da56cc None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:37.081046 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47921998-b331-41d9-ae3e-a8b582da56cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:37.106200 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970f95aa-1a40-469b-8c9b-142d47257cec None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:37.138874 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:37.142112 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b3d26b-2bfa-4247-803f-a078140071e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:37.142734 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b3d26b-2bfa-4247-803f-a078140071e7 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:37.143010 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b3d26b-2bfa-4247-803f-a078140071e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:37.143290 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b3d26b-2bfa-4247-803f-a078140071e7 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:37.151436 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b3d26b-2bfa-4247-803f-a078140071e7 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:37.154859 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b3d26b-2bfa-4247-803f-a078140071e7 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:37.159762 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47921998-b331-41d9-ae3e-a8b582da56cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:37.169769 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47921998-b331-41d9-ae3e-a8b582da56cc None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:37.169898 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application [None req-b3b3d26b-2bfa-4247-803f-a078140071e7 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 18 19:28:37.169898 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:37.169898 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:37.169898 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:37.169898 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:37.169898 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:37.169898 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:37.169898 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:37.169898 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:37.169898 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:37.169898 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:37.169898 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:37.169898 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 19:28:37.169898 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 19:28:37.169898 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 19:28:37.169898 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 19:28:37.171011 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:37.171011 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:37.171011 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 19:28:37.171011 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 19:28:37.171011 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 19:28:37.171011 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 19:28:37.171011 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:37.171011 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:37.171011 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:37.171011 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:37.171011 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:37.171011 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:37.171011 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:37.171011 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:37.171011 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:37.171011 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:37.171011 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:37.171011 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:37.172054 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:37.172054 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:37.172054 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 19:28:37.172054 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 19:28:37.172054 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 19:28:37.172054 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 19:28:37.172054 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 19:28:37.172054 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 19:28:37.172054 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 18 19:28:37.172054 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:28:37.172054 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 317/620] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Aug 18 19:28:36 2022] GET /identity/v3/users/neutron => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:28:37.172054 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b3d26b-2bfa-4247-803f-a078140071e7 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:37.230024 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:37.282552 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b3d26b-2bfa-4247-803f-a078140071e7 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:37.301751 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 304/621] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Aug 18 19:28:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 19:28:37.303128 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47921998-b331-41d9-ae3e-a8b582da56cc None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:37.321078 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63692892-9faf-4a88-b61a-2e1da6f7e523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:37.321824 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63692892-9faf-4a88-b61a-2e1da6f7e523 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:37.322169 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63692892-9faf-4a88-b61a-2e1da6f7e523 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:37.322443 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63692892-9faf-4a88-b61a-2e1da6f7e523 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:37.399630 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:37.401119 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63692892-9faf-4a88-b61a-2e1da6f7e523 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:37.402619 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63692892-9faf-4a88-b61a-2e1da6f7e523 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:37.417313 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47921998-b331-41d9-ae3e-a8b582da56cc None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:37.454477 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:37.455366 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea64e54-e97c-4dc8-98b1-c9053444beea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:37.456050 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea64e54-e97c-4dc8-98b1-c9053444beea None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:37.456358 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea64e54-e97c-4dc8-98b1-c9053444beea None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:37.456599 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea64e54-e97c-4dc8-98b1-c9053444beea None admin] PATH_INFO: `/v3/users` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:37.457315 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea64e54-e97c-4dc8-98b1-c9053444beea None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:37.457618 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea64e54-e97c-4dc8-98b1-c9053444beea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:37.459077 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea64e54-e97c-4dc8-98b1-c9053444beea None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:37.481142 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 305/622] 10.222.0.23 () {56 vars in 1139 bytes} [Thu Aug 18 19:28:37 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:37.481142 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea64e54-e97c-4dc8-98b1-c9053444beea None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:37.510694 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 318/623] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Aug 18 19:28:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 19:28:37.511688 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63692892-9faf-4a88-b61a-2e1da6f7e523 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:37.589450 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea64e54-e97c-4dc8-98b1-c9053444beea None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:37.619114 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63692892-9faf-4a88-b61a-2e1da6f7e523 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:37.629508 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e06f33f-9df5-4e60-887a-27c9add4a8f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:37.630467 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e06f33f-9df5-4e60-887a-27c9add4a8f1 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:37.630761 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e06f33f-9df5-4e60-887a-27c9add4a8f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:37.631037 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e06f33f-9df5-4e60-887a-27c9add4a8f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:37.641132 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e06f33f-9df5-4e60-887a-27c9add4a8f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:37.642615 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e06f33f-9df5-4e60-887a-27c9add4a8f1 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:37.644482 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:37.655282 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cef8db5-51f6-46c1-aa34-7564af3cd347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:37.658807 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef8db5-51f6-46c1-aa34-7564af3cd347 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:37.658807 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef8db5-51f6-46c1-aa34-7564af3cd347 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:37.658807 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef8db5-51f6-46c1-aa34-7564af3cd347 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:37.659053 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application [None req-4e06f33f-9df5-4e60-887a-27c9add4a8f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:28:37.659053 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:37.659053 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:37.659053 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:37.659053 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:37.659053 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:37.659053 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:37.659053 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:37.659053 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:37.659053 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:37.659053 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:37.659053 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:37.659053 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 19:28:37.659053 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 19:28:37.659053 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 19:28:37.659053 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 19:28:37.660131 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:37.660131 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:37.660131 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:37.660131 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:37.660131 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:37.660131 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:37.660131 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:37.660131 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:37.660131 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:37.660131 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:37.660131 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:37.660131 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:37.660131 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:37.660131 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:37.660131 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:37.660131 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:37.660131 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 19:28:37.661534 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 19:28:37.661534 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:28:37.661534 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:28:37.664616 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 306/624] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Aug 18 19:28:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:28:37.665490 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e06f33f-9df5-4e60-887a-27c9add4a8f1 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:37.682335 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:37.731271 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cef8db5-51f6-46c1-aa34-7564af3cd347 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:37.733342 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cef8db5-51f6-46c1-aa34-7564af3cd347 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:37.770117 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e06f33f-9df5-4e60-887a-27c9add4a8f1 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:37.808609 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2718920-b2b2-485c-8331-0efe6dcdca99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:37.809249 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2718920-b2b2-485c-8331-0efe6dcdca99 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:37.809578 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2718920-b2b2-485c-8331-0efe6dcdca99 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:37.810006 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2718920-b2b2-485c-8331-0efe6dcdca99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:37.820781 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2718920-b2b2-485c-8331-0efe6dcdca99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:37.822259 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2718920-b2b2-485c-8331-0efe6dcdca99 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:37.836859 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application [None req-f2718920-b2b2-485c-8331-0efe6dcdca99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:28:37.836859 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:37.836859 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:37.836859 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:37.836859 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:37.836859 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:37.836859 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:37.836859 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:37.836859 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:37.836859 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:37.836859 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:37.836859 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:37.836859 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 19:28:37.836859 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 19:28:37.836859 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 19:28:37.836859 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 19:28:37.838377 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:37.838377 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:37.838377 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:37.838377 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:37.838377 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:37.838377 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:37.838377 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:37.838377 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:37.838377 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:37.838377 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:37.838377 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:37.838377 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:37.838377 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:37.838377 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:37.838377 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:37.838377 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:37.838377 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 19:28:37.839251 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 19:28:37.839251 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:28:37.839251 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:28:37.839512 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 319/625] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Aug 18 19:28:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 19:28:37.839512 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cef8db5-51f6-46c1-aa34-7564af3cd347 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:37.843608 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 307/626] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Aug 18 19:28:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:28:37.843956 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2718920-b2b2-485c-8331-0efe6dcdca99 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:37.893256 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:37.894677 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:37.941448 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cef8db5-51f6-46c1-aa34-7564af3cd347 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:37.950046 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2718920-b2b2-485c-8331-0efe6dcdca99 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:37.977243 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d935419-88ba-4ad2-9e3d-761b6e1624ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:37.977975 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d935419-88ba-4ad2-9e3d-761b6e1624ac None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:37.978329 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d935419-88ba-4ad2-9e3d-761b6e1624ac None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:37.978680 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d935419-88ba-4ad2-9e3d-761b6e1624ac None admin] PATH_INFO: `/v3/domains` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:37.979428 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d935419-88ba-4ad2-9e3d-761b6e1624ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:37.979832 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d935419-88ba-4ad2-9e3d-761b6e1624ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:37.981324 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d935419-88ba-4ad2-9e3d-761b6e1624ac None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:37.986247 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e734487-d16a-4ead-92b8-05d49ff2558c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:37.986872 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e734487-d16a-4ead-92b8-05d49ff2558c None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:37.987152 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e734487-d16a-4ead-92b8-05d49ff2558c None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:37.987424 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e734487-d16a-4ead-92b8-05d49ff2558c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:37.994329 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 320/627] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Aug 18 19:28:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:37.997536 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d935419-88ba-4ad2-9e3d-761b6e1624ac None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:38.000600 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e734487-d16a-4ead-92b8-05d49ff2558c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:38.002155 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e734487-d16a-4ead-92b8-05d49ff2558c None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:38.018974 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application [None req-4e734487-d16a-4ead-92b8-05d49ff2558c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:28:38.018974 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:38.018974 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:38.018974 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:38.018974 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:38.018974 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:38.018974 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:38.018974 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:38.018974 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:38.018974 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:38.018974 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:38.018974 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:38.018974 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 19:28:38.018974 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 19:28:38.018974 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 19:28:38.018974 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 19:28:38.020226 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:38.020226 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:38.020226 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:38.020226 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:38.020226 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:38.020226 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:38.020226 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:38.020226 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:38.020226 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:38.020226 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:38.020226 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:38.020226 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:38.020226 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:38.020226 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:38.020226 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:38.020226 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:38.020226 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 19:28:38.021117 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 19:28:38.021117 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:28:38.021117 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:28:38.021117 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 308/628] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Aug 18 19:28:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:28:38.021429 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e734487-d16a-4ead-92b8-05d49ff2558c None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:38.115868 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d935419-88ba-4ad2-9e3d-761b6e1624ac None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:38.130212 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:38.136898 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:38.141212 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e734487-d16a-4ead-92b8-05d49ff2558c None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:38.152860 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938c1130-8726-4228-9fd6-33db6726f873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:38.154277 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c1130-8726-4228-9fd6-33db6726f873 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:38.154722 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c1130-8726-4228-9fd6-33db6726f873 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:38.155144 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c1130-8726-4228-9fd6-33db6726f873 None admin] PATH_INFO: `/v3/domains` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:38.155963 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938c1130-8726-4228-9fd6-33db6726f873 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:38.156261 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938c1130-8726-4228-9fd6-33db6726f873 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:38.157743 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938c1130-8726-4228-9fd6-33db6726f873 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:38.170592 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 321/629] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Aug 18 19:28:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:38.171417 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938c1130-8726-4228-9fd6-33db6726f873 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:38.177983 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7db394-8dc7-4208-af7a-419bfb9c5699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:38.178623 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7db394-8dc7-4208-af7a-419bfb9c5699 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:38.178904 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7db394-8dc7-4208-af7a-419bfb9c5699 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:38.179180 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7db394-8dc7-4208-af7a-419bfb9c5699 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:38.186485 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7db394-8dc7-4208-af7a-419bfb9c5699 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:38.187920 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7db394-8dc7-4208-af7a-419bfb9c5699 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:38.199536 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application [None req-3c7db394-8dc7-4208-af7a-419bfb9c5699 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 19:28:38.199536 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:38.199536 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:38.199536 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:38.199536 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:38.199536 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:38.199536 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:38.199536 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:38.199536 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:38.199536 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:38.199536 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:38.199536 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:38.199536 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 19:28:38.199536 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 19:28:38.199536 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 19:28:38.200966 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 19:28:38.200966 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:38.200966 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:38.200966 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:38.200966 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:38.200966 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:38.200966 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:38.200966 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:38.200966 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:38.200966 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:38.200966 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:38.200966 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:38.200966 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:38.200966 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:38.200966 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:38.200966 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:38.200966 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:38.201893 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 19:28:38.201893 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 19:28:38.201893 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 19:28:38.201893 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 19:28:38.201893 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 19:28:38.201893 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 19:28:38.201893 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 19:28:38.201893 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:28:38.201893 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 309/630] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Aug 18 19:28:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:28:38.202724 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59534b18-ee32-48ca-ad91-6e0b660fee67 None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:38.203011 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59534b18-ee32-48ca-ad91-6e0b660fee67 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:38.203285 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59534b18-ee32-48ca-ad91-6e0b660fee67 None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:38.204493 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 310/631] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:28:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:28:38.205176 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59534b18-ee32-48ca-ad91-6e0b660fee67 None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:38.276218 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938c1130-8726-4228-9fd6-33db6726f873 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:38.304576 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59534b18-ee32-48ca-ad91-6e0b660fee67 None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:38.308704 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2928580f-95b7-4d4c-9216-06e4f58e0dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:38.309298 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2928580f-95b7-4d4c-9216-06e4f58e0dd5 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:38.310140 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2928580f-95b7-4d4c-9216-06e4f58e0dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:38.310412 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2928580f-95b7-4d4c-9216-06e4f58e0dd5 None admin] PATH_INFO: `/v3/domains` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:38.311036 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2928580f-95b7-4d4c-9216-06e4f58e0dd5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:38.311333 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2928580f-95b7-4d4c-9216-06e4f58e0dd5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:38.312684 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2928580f-95b7-4d4c-9216-06e4f58e0dd5 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:38.324331 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 322/632] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Aug 18 19:28:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:38.325031 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2928580f-95b7-4d4c-9216-06e4f58e0dd5 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:38.339011 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718773bb-a5b4-4189-9a94-1a023dc47f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:38.339626 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718773bb-a5b4-4189-9a94-1a023dc47f91 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:38.339900 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718773bb-a5b4-4189-9a94-1a023dc47f91 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:38.340167 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718773bb-a5b4-4189-9a94-1a023dc47f91 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:38.346913 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718773bb-a5b4-4189-9a94-1a023dc47f91 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:38.348346 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718773bb-a5b4-4189-9a94-1a023dc47f91 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:38.357869 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:38.359510 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application [None req-718773bb-a5b4-4189-9a94-1a023dc47f91 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 19:28:38.359510 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:38.359510 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:38.359510 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:38.359510 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:38.359510 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:38.359510 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:38.359510 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:38.359510 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:38.359510 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:38.359510 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:38.359510 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:38.359510 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 19:28:38.359510 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 19:28:38.359510 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 19:28:38.360459 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 19:28:38.360459 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:38.360459 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:38.360459 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:38.360459 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:38.360459 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:38.360459 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:38.360459 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:38.360459 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:38.360459 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:38.360459 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:38.360459 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:38.360459 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:38.360459 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:38.360459 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:38.360459 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:38.360459 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:38.361332 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 19:28:38.361332 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 19:28:38.361332 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 19:28:38.361332 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 19:28:38.361332 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 19:28:38.361332 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 19:28:38.361332 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 19:28:38.361332 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:28:38.361332 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 311/633] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Aug 18 19:28:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:28:38.362139 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77514c2-1cbc-4157-bb40-5bc568b66349 None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:38.362334 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77514c2-1cbc-4157-bb40-5bc568b66349 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:38.362610 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77514c2-1cbc-4157-bb40-5bc568b66349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:38.380378 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-c77514c2-1cbc-4157-bb40-5bc568b66349 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:28:38.381489 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-c77514c2-1cbc-4157-bb40-5bc568b66349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:28:38.395254 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:38.432254 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2928580f-95b7-4d4c-9216-06e4f58e0dd5 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:38.449256 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 312/634] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:28:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:28:38.450780 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77514c2-1cbc-4157-bb40-5bc568b66349 None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:38.468771 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbff9b2-9bf3-45c5-97dd-6829f5fdc4b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:38.469470 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbff9b2-9bf3-45c5-97dd-6829f5fdc4b8 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:38.469848 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbff9b2-9bf3-45c5-97dd-6829f5fdc4b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:38.470133 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbff9b2-9bf3-45c5-97dd-6829f5fdc4b8 None admin] PATH_INFO: `/v3/projects` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:38.470823 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbff9b2-9bf3-45c5-97dd-6829f5fdc4b8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:38.471131 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbff9b2-9bf3-45c5-97dd-6829f5fdc4b8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:38.472598 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbff9b2-9bf3-45c5-97dd-6829f5fdc4b8 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:38.484387 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 323/635] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Aug 18 19:28:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:38.486542 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbff9b2-9bf3-45c5-97dd-6829f5fdc4b8 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:38.554283 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77514c2-1cbc-4157-bb40-5bc568b66349 None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:38.592130 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e4d5a8-a323-4e44-8159-a08eacda85bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:38.592758 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e4d5a8-a323-4e44-8159-a08eacda85bd None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:38.593035 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e4d5a8-a323-4e44-8159-a08eacda85bd None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:38.593303 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e4d5a8-a323-4e44-8159-a08eacda85bd None admin] PATH_INFO: `/v3/projects/service` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:38.600753 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e4d5a8-a323-4e44-8159-a08eacda85bd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:38.602293 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e4d5a8-a323-4e44-8159-a08eacda85bd None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:38.603837 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:38.613071 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbff9b2-9bf3-45c5-97dd-6829f5fdc4b8 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:38.613498 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application [None req-b8e4d5a8-a323-4e44-8159-a08eacda85bd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 19:28:38.613498 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:38.613498 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:38.613498 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:38.613498 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:38.613498 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:38.613498 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:38.613498 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:38.613498 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:38.613498 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:38.613498 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:38.613498 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:38.613498 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 19:28:38.613498 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 19:28:38.613498 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 19:28:38.621186 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 19:28:38.621186 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:38.621186 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:38.621186 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:38.621186 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:38.621186 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:38.621186 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:38.621186 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:38.621186 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:38.621186 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:38.621186 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:38.621186 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:38.621186 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:38.621186 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:38.621186 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:38.621186 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:38.621186 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:38.622949 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 19:28:38.622949 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 19:28:38.622949 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 19:28:38.622949 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 19:28:38.622949 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 19:28:38.622949 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 19:28:38.622949 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 19:28:38.622949 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:28:38.622949 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 313/636] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Aug 18 19:28:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:28:38.622949 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e4d5a8-a323-4e44-8159-a08eacda85bd None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:38.626902 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:38.653503 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5154eab1-89a0-4de1-89bd-7f72bff44958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:38.654186 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5154eab1-89a0-4de1-89bd-7f72bff44958 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:38.654440 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5154eab1-89a0-4de1-89bd-7f72bff44958 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:38.654710 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5154eab1-89a0-4de1-89bd-7f72bff44958 None admin] PATH_INFO: `/v3/projects` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:38.655485 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5154eab1-89a0-4de1-89bd-7f72bff44958 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:38.655792 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5154eab1-89a0-4de1-89bd-7f72bff44958 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:38.657209 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5154eab1-89a0-4de1-89bd-7f72bff44958 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:38.673797 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 324/637] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Aug 18 19:28:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:38.673797 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5154eab1-89a0-4de1-89bd-7f72bff44958 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:38.722465 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e4d5a8-a323-4e44-8159-a08eacda85bd None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:38.758133 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9106cc7-039a-4630-b79e-aa2e3856c96c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:38.758709 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9106cc7-039a-4630-b79e-aa2e3856c96c None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:38.758983 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9106cc7-039a-4630-b79e-aa2e3856c96c None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:38.759249 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9106cc7-039a-4630-b79e-aa2e3856c96c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:38.759956 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9106cc7-039a-4630-b79e-aa2e3856c96c None admin] RBAC: Adding query filter params (role.id=2a89ce9253da431fb2d0bf1ff51e1426, scope.project.id=a44b197c3aa0479092f4d77d2c791c39, user.id=62ab2be725844b49bde7941867d672d1) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:38.760259 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9106cc7-039a-4630-b79e-aa2e3856c96c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:38.761679 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9106cc7-039a-4630-b79e-aa2e3856c96c None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:38.767697 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 314/638] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Aug 18 19:28:38 2022] GET /identity/v3/role_assignments?user.id=62ab2be725844b49bde7941867d672d1&scope.project.id=a44b197c3aa0479092f4d77d2c791c39&role.id=2a89ce9253da431fb2d0bf1ff51e1426 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:38.768387 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9106cc7-039a-4630-b79e-aa2e3856c96c None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:38.787694 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5154eab1-89a0-4de1-89bd-7f72bff44958 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:38.826629 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d43341-7fd1-4dfe-8cce-e7c513dff830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:38.827432 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d43341-7fd1-4dfe-8cce-e7c513dff830 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:38.827809 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d43341-7fd1-4dfe-8cce-e7c513dff830 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:38.828182 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d43341-7fd1-4dfe-8cce-e7c513dff830 None admin] PATH_INFO: `/v3/projects` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:38.829109 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d43341-7fd1-4dfe-8cce-e7c513dff830 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:38.829517 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d43341-7fd1-4dfe-8cce-e7c513dff830 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:38.831129 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d43341-7fd1-4dfe-8cce-e7c513dff830 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:38.849934 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 325/639] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Aug 18 19:28:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:38.849934 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d43341-7fd1-4dfe-8cce-e7c513dff830 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:38.858192 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:38.864236 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:38.890734 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9106cc7-039a-4630-b79e-aa2e3856c96c None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:38.931514 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69ac112-089b-49dd-a67a-d610c4005a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:38.932201 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ac112-089b-49dd-a67a-d610c4005a75 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:38.932905 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ac112-089b-49dd-a67a-d610c4005a75 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:38.932905 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ac112-089b-49dd-a67a-d610c4005a75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:38.933792 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69ac112-089b-49dd-a67a-d610c4005a75 None admin] RBAC: Adding query filter params (role.id=2a89ce9253da431fb2d0bf1ff51e1426, scope.project.id=a44b197c3aa0479092f4d77d2c791c39, user.id=28c99ca9206340269f30be592fcd3f75) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:38.934337 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69ac112-089b-49dd-a67a-d610c4005a75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:38.936487 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69ac112-089b-49dd-a67a-d610c4005a75 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:38.953681 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 315/640] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Aug 18 19:28:38 2022] GET /identity/v3/role_assignments?user.id=28c99ca9206340269f30be592fcd3f75&scope.project.id=a44b197c3aa0479092f4d77d2c791c39&role.id=2a89ce9253da431fb2d0bf1ff51e1426 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:38.953681 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69ac112-089b-49dd-a67a-d610c4005a75 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:38.979254 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d43341-7fd1-4dfe-8cce-e7c513dff830 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:39.026122 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ce784d-d6dc-4f2a-824c-ad3709cedbff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:39.026808 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ce784d-d6dc-4f2a-824c-ad3709cedbff None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:39.026808 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ce784d-d6dc-4f2a-824c-ad3709cedbff None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:39.026994 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ce784d-d6dc-4f2a-824c-ad3709cedbff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:39.040082 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ce784d-d6dc-4f2a-824c-ad3709cedbff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:28:39.045556 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application [None req-39ce784d-d6dc-4f2a-824c-ad3709cedbff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 19:28:39.045556 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:39.045556 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:39.045556 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:39.045556 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:39.045556 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:39.045556 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:39.045556 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:39.045556 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:39.045556 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:39.045556 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:39.045556 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:39.045556 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:28:39.045556 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:28:39.045556 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:28:39.045556 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:28:39.051546 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:28:39.051546 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:28:39.051546 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:28:39.051546 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:28:39.051546 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:39.051546 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:39.051546 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:39.051546 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:39.051546 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:39.051546 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:39.051546 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:39.051546 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:39.051546 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:39.051546 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:39.051546 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:39.051546 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:39.052607 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:39.052607 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:39.052607 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:39.052607 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:39.052607 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:28:39.052607 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:28:39.052607 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:28:39.052607 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:28:39.052607 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:28:39.052607 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:28:39.052607 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 19:28:39.052607 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:28:39.052607 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 326/641] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Aug 18 19:28:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:28:39.055424 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ce784d-d6dc-4f2a-824c-ad3709cedbff None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:39.102895 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69ac112-089b-49dd-a67a-d610c4005a75 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:39.150224 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bac72e-c7cd-4bd4-8476-3970dd36910c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:39.150837 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bac72e-c7cd-4bd4-8476-3970dd36910c None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:39.151274 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bac72e-c7cd-4bd4-8476-3970dd36910c None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:39.151537 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bac72e-c7cd-4bd4-8476-3970dd36910c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:39.152805 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bac72e-c7cd-4bd4-8476-3970dd36910c None admin] RBAC: Adding query filter params (role.id=2a89ce9253da431fb2d0bf1ff51e1426, scope.project.id=a44b197c3aa0479092f4d77d2c791c39, user.id=516923ce386f459190af3fd7eaa81551) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:39.153637 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bac72e-c7cd-4bd4-8476-3970dd36910c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:39.155395 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bac72e-c7cd-4bd4-8476-3970dd36910c None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:39.156689 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:39.159396 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:39.163349 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 316/642] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Aug 18 19:28:38 2022] GET /identity/v3/role_assignments?user.id=516923ce386f459190af3fd7eaa81551&scope.project.id=a44b197c3aa0479092f4d77d2c791c39&role.id=2a89ce9253da431fb2d0bf1ff51e1426 => generated 608 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:39.203777 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ce784d-d6dc-4f2a-824c-ad3709cedbff None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:39.245370 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c857a336-5b5d-48df-8e16-a0e7d9357812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:39.246316 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857a336-5b5d-48df-8e16-a0e7d9357812 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:39.246770 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857a336-5b5d-48df-8e16-a0e7d9357812 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:39.247295 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857a336-5b5d-48df-8e16-a0e7d9357812 None admin] PATH_INFO: `/v3/roles` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:39.248130 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c857a336-5b5d-48df-8e16-a0e7d9357812 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:39.248602 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c857a336-5b5d-48df-8e16-a0e7d9357812 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:39.250201 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c857a336-5b5d-48df-8e16-a0e7d9357812 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:39.260115 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 327/643] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Aug 18 19:28:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:39.265566 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bac72e-c7cd-4bd4-8476-3970dd36910c None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:39.379812 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bac72e-c7cd-4bd4-8476-3970dd36910c None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:39.416425 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838299ef-9819-441a-bb14-0d39a1d1e934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:39.417067 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838299ef-9819-441a-bb14-0d39a1d1e934 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:39.417348 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838299ef-9819-441a-bb14-0d39a1d1e934 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:39.417621 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838299ef-9819-441a-bb14-0d39a1d1e934 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:39.429862 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838299ef-9819-441a-bb14-0d39a1d1e934 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:39.431004 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838299ef-9819-441a-bb14-0d39a1d1e934 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:39.447254 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application [None req-838299ef-9819-441a-bb14-0d39a1d1e934 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:28:39.447254 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:39.447254 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:39.447254 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:39.447254 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:39.447254 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:39.447254 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:39.447254 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:39.447254 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:39.447254 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:39.447254 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:39.447254 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:39.447254 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 19:28:39.447254 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 19:28:39.447254 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 19:28:39.447254 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 19:28:39.448247 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:39.448247 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:39.448247 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:39.448247 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:39.448247 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:39.448247 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:39.448247 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:39.448247 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:39.448247 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:39.448247 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:39.448247 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:39.448247 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:39.448247 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:39.448247 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:39.448247 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:39.448247 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:39.448247 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 19:28:39.449146 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 19:28:39.449146 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:28:39.449146 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:28:39.449146 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 317/644] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Aug 18 19:28:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 19:28:39.457320 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c857a336-5b5d-48df-8e16-a0e7d9357812 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:39.565592 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c857a336-5b5d-48df-8e16-a0e7d9357812 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:39.606854 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa91e48-c8c2-4abe-8a7e-fd66c66d98d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:39.607836 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa91e48-c8c2-4abe-8a7e-fd66c66d98d0 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:39.608318 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa91e48-c8c2-4abe-8a7e-fd66c66d98d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:39.608791 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa91e48-c8c2-4abe-8a7e-fd66c66d98d0 None admin] PATH_INFO: `/v3/domains` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:39.609623 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa91e48-c8c2-4abe-8a7e-fd66c66d98d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:39.610174 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa91e48-c8c2-4abe-8a7e-fd66c66d98d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:39.611864 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa91e48-c8c2-4abe-8a7e-fd66c66d98d0 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:39.613487 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:39.625301 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 328/645] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Aug 18 19:28:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:39.631277 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838299ef-9819-441a-bb14-0d39a1d1e934 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:39.687420 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:39.742047 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838299ef-9819-441a-bb14-0d39a1d1e934 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:39.776802 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a94c9f-99f1-4a9e-a6b4-e7116c5ecaeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:39.777429 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a94c9f-99f1-4a9e-a6b4-e7116c5ecaeb None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:39.777734 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a94c9f-99f1-4a9e-a6b4-e7116c5ecaeb None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:39.778011 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a94c9f-99f1-4a9e-a6b4-e7116c5ecaeb None admin] PATH_INFO: `/v3/users/nova` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:39.786189 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a94c9f-99f1-4a9e-a6b4-e7116c5ecaeb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:39.787616 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a94c9f-99f1-4a9e-a6b4-e7116c5ecaeb None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:39.798752 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application [None req-38a94c9f-99f1-4a9e-a6b4-e7116c5ecaeb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 18 19:28:39.798752 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:39.798752 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:39.798752 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:39.798752 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:39.798752 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:39.798752 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:39.798752 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:39.798752 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:39.798752 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:39.798752 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:39.798752 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:39.798752 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 19:28:39.798752 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 19:28:39.798752 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 19:28:39.798752 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 19:28:39.799790 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:39.799790 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:39.799790 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 19:28:39.799790 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 19:28:39.799790 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 19:28:39.799790 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 19:28:39.799790 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:39.799790 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:39.799790 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:39.799790 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:39.799790 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:39.799790 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:39.799790 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:39.799790 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:39.799790 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:39.799790 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:39.799790 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:39.799790 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:39.800709 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:39.800709 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:39.800709 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 19:28:39.800709 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 19:28:39.800709 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 19:28:39.800709 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 19:28:39.800709 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 19:28:39.800709 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 19:28:39.800709 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 18 19:28:39.800709 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:28:39.800709 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 318/646] 10.222.0.23 () {56 vars in 1093 bytes} [Thu Aug 18 19:28:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:28:39.806073 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa91e48-c8c2-4abe-8a7e-fd66c66d98d0 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:39.909042 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa91e48-c8c2-4abe-8a7e-fd66c66d98d0 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:39.944884 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b13068-90ef-4d9c-87e0-b432553e6d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:39.945492 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b13068-90ef-4d9c-87e0-b432553e6d31 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:39.945808 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b13068-90ef-4d9c-87e0-b432553e6d31 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:39.946081 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b13068-90ef-4d9c-87e0-b432553e6d31 None admin] PATH_INFO: `/v3/users` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:39.946802 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b13068-90ef-4d9c-87e0-b432553e6d31 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:39.947107 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b13068-90ef-4d9c-87e0-b432553e6d31 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:39.948551 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b13068-90ef-4d9c-87e0-b432553e6d31 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:39.968285 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 329/647] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Aug 18 19:28:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:39.973941 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a94c9f-99f1-4a9e-a6b4-e7116c5ecaeb None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:40.080753 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a94c9f-99f1-4a9e-a6b4-e7116c5ecaeb None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:40.094506 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:40.118383 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb5a3f8-7a6b-4bd4-90f8-0ca3225b2350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:40.118989 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb5a3f8-7a6b-4bd4-90f8-0ca3225b2350 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:40.119261 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb5a3f8-7a6b-4bd4-90f8-0ca3225b2350 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:40.119528 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb5a3f8-7a6b-4bd4-90f8-0ca3225b2350 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:40.189560 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb5a3f8-7a6b-4bd4-90f8-0ca3225b2350 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:40.191056 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb5a3f8-7a6b-4bd4-90f8-0ca3225b2350 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:40.292950 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 319/648] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Aug 18 19:28:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 19:28:40.298744 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b13068-90ef-4d9c-87e0-b432553e6d31 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:40.354592 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:40.405171 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b13068-90ef-4d9c-87e0-b432553e6d31 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:40.441497 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af6d2ff-41f1-4f44-b606-6275c19529af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:40.442159 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af6d2ff-41f1-4f44-b606-6275c19529af None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:40.442438 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af6d2ff-41f1-4f44-b606-6275c19529af None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:40.442710 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af6d2ff-41f1-4f44-b606-6275c19529af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:40.453106 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af6d2ff-41f1-4f44-b606-6275c19529af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:40.454583 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af6d2ff-41f1-4f44-b606-6275c19529af None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:40.469567 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application [None req-7af6d2ff-41f1-4f44-b606-6275c19529af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:28:40.469567 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:40.469567 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:40.469567 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:40.469567 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:40.469567 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:40.469567 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:40.469567 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:40.469567 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:40.469567 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:40.469567 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:40.469567 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:40.469567 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 19:28:40.469567 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 19:28:40.469567 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 19:28:40.469567 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 19:28:40.470546 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:40.470546 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:40.470546 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:40.470546 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:40.470546 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:40.470546 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:40.470546 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:40.470546 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:40.470546 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:40.470546 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:40.470546 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:40.470546 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:40.470546 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:40.470546 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:40.470546 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:40.470546 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:40.470546 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 19:28:40.471418 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 19:28:40.471418 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:28:40.471418 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:28:40.472790 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 330/649] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Aug 18 19:28:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:28:40.482802 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb5a3f8-7a6b-4bd4-90f8-0ca3225b2350 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:40.498014 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:40.584622 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb5a3f8-7a6b-4bd4-90f8-0ca3225b2350 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:40.619365 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f886aa-161a-4544-a921-9570318a0a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:40.620082 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f886aa-161a-4544-a921-9570318a0a9e None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:40.620365 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f886aa-161a-4544-a921-9570318a0a9e None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:40.620637 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f886aa-161a-4544-a921-9570318a0a9e None admin] PATH_INFO: `/v3/domains` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:40.621271 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f886aa-161a-4544-a921-9570318a0a9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:40.621573 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f886aa-161a-4544-a921-9570318a0a9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:40.623464 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f886aa-161a-4544-a921-9570318a0a9e None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:40.635220 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 320/650] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Aug 18 19:28:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:40.641601 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af6d2ff-41f1-4f44-b606-6275c19529af None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:40.747421 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af6d2ff-41f1-4f44-b606-6275c19529af None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:40.749839 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:40.782909 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6356a79-8ad7-4c8b-9ef8-387df7537616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:40.783545 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6356a79-8ad7-4c8b-9ef8-387df7537616 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:40.783832 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6356a79-8ad7-4c8b-9ef8-387df7537616 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:40.784102 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6356a79-8ad7-4c8b-9ef8-387df7537616 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:40.791187 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6356a79-8ad7-4c8b-9ef8-387df7537616 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:40.793185 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6356a79-8ad7-4c8b-9ef8-387df7537616 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:40.804449 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application [None req-c6356a79-8ad7-4c8b-9ef8-387df7537616 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 19:28:40.804449 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:40.804449 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:40.804449 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:40.804449 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:40.804449 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:40.804449 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:40.804449 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:40.804449 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:40.804449 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:40.804449 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:40.804449 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:40.804449 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 19:28:40.804449 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 19:28:40.804449 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 19:28:40.805324 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 19:28:40.805324 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:40.805324 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:40.805324 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:40.805324 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:40.805324 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:40.805324 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:40.805324 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:40.805324 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:40.805324 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:40.805324 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:40.805324 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:40.805324 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:40.805324 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:40.805324 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:40.805324 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:40.805324 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:40.806681 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 19:28:40.806681 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 19:28:40.806681 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 19:28:40.806681 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 19:28:40.806681 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 19:28:40.806681 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 19:28:40.806681 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 19:28:40.806681 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:28:40.806681 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 331/651] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Aug 18 19:28:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:28:40.812150 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f886aa-161a-4544-a921-9570318a0a9e None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:40.883867 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:40.914478 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f886aa-161a-4544-a921-9570318a0a9e None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:40.949992 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb82278d-bd5b-4f0a-9c76-4aa755620883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:40.950605 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb82278d-bd5b-4f0a-9c76-4aa755620883 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:40.950882 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb82278d-bd5b-4f0a-9c76-4aa755620883 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:40.951150 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb82278d-bd5b-4f0a-9c76-4aa755620883 None admin] PATH_INFO: `/v3/projects` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:40.951834 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb82278d-bd5b-4f0a-9c76-4aa755620883 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:40.952136 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb82278d-bd5b-4f0a-9c76-4aa755620883 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:40.953697 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb82278d-bd5b-4f0a-9c76-4aa755620883 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:40.966828 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 321/652] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Aug 18 19:28:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:40.972941 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6356a79-8ad7-4c8b-9ef8-387df7537616 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:41.084042 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6356a79-8ad7-4c8b-9ef8-387df7537616 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:41.119864 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fb5e95-fcd4-456c-9ac2-dbf3a750e17d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:41.120470 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb5e95-fcd4-456c-9ac2-dbf3a750e17d None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:41.120813 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb5e95-fcd4-456c-9ac2-dbf3a750e17d None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:41.121087 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb5e95-fcd4-456c-9ac2-dbf3a750e17d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:41.122434 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fb5e95-fcd4-456c-9ac2-dbf3a750e17d None admin] RBAC: Adding query filter params (role.id=33fe6be3baf44b969c8166af5142e0c7, scope.project.id=a44b197c3aa0479092f4d77d2c791c39, user.id=9c3560e900d248bc93147ddce515365b) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:41.122745 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fb5e95-fcd4-456c-9ac2-dbf3a750e17d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:41.124167 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fb5e95-fcd4-456c-9ac2-dbf3a750e17d None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:41.130162 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 332/653] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Aug 18 19:28:40 2022] GET /identity/v3/role_assignments?user.id=9c3560e900d248bc93147ddce515365b&scope.project.id=a44b197c3aa0479092f4d77d2c791c39&role.id=33fe6be3baf44b969c8166af5142e0c7 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:41.181098 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05049afb-efb6-47a5-851d-69635cfb3094 None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:41.181872 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05049afb-efb6-47a5-851d-69635cfb3094 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:41.182356 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05049afb-efb6-47a5-851d-69635cfb3094 None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:41.186133 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 322/654] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:28:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:28:41.192407 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e169e18c-1fe9-47e9-b8f6-326c04feb5ed None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:41.193056 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e169e18c-1fe9-47e9-b8f6-326c04feb5ed None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:41.193565 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e169e18c-1fe9-47e9-b8f6-326c04feb5ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:41.213469 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-e169e18c-1fe9-47e9-b8f6-326c04feb5ed None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:28:41.215081 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-e169e18c-1fe9-47e9-b8f6-326c04feb5ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:28:41.242063 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:41.296373 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 333/655] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:28:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:28:41.345682 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c29525-bb71-4381-9138-a6bb4c3bc3c3 None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:41.346218 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c29525-bb71-4381-9138-a6bb4c3bc3c3 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:41.346218 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c29525-bb71-4381-9138-a6bb4c3bc3c3 None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:41.348578 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 323/656] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:28:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:28:41.352980 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b599c-a447-4f51-a862-5abd8a680045 None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:41.353528 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b599c-a447-4f51-a862-5abd8a680045 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:41.354031 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b599c-a447-4f51-a862-5abd8a680045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:41.374387 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-456b599c-a447-4f51-a862-5abd8a680045 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:28:41.375938 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-456b599c-a447-4f51-a862-5abd8a680045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:28:41.447967 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 334/657] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:28:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:28:41.535610 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7656b-72a1-4ca0-b6a8-54d6f2b641fd None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:41.535957 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7656b-72a1-4ca0-b6a8-54d6f2b641fd None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:41.536166 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7656b-72a1-4ca0-b6a8-54d6f2b641fd None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:41.537773 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 324/658] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:28:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:28:41.542722 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e682bb4e-788e-4961-9d5a-d20aefeb0001 None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:41.543234 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e682bb4e-788e-4961-9d5a-d20aefeb0001 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:41.544284 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e682bb4e-788e-4961-9d5a-d20aefeb0001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:41.562726 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-e682bb4e-788e-4961-9d5a-d20aefeb0001 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:28:41.564160 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-e682bb4e-788e-4961-9d5a-d20aefeb0001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:28:41.634607 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 335/659] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:28:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:28:41.662032 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e7656b-72a1-4ca0-b6a8-54d6f2b641fd None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:41.772203 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e7656b-72a1-4ca0-b6a8-54d6f2b641fd None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:41.777821 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e682bb4e-788e-4961-9d5a-d20aefeb0001 None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:41.805640 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:41.805983 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:41.809849 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c61fe0d-5a07-4c8b-ba57-67002ef756a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:41.810495 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c61fe0d-5a07-4c8b-ba57-67002ef756a9 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:41.810771 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c61fe0d-5a07-4c8b-ba57-67002ef756a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:41.811041 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c61fe0d-5a07-4c8b-ba57-67002ef756a9 None admin] PATH_INFO: `/v3/services/image` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:41.811683 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c61fe0d-5a07-4c8b-ba57-67002ef756a9 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:41.813050 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c61fe0d-5a07-4c8b-ba57-67002ef756a9 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:41.828824 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application [None req-5c61fe0d-5a07-4c8b-ba57-67002ef756a9 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 19:28:41.828824 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:41.828824 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 19:28:41.828824 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 19:28:41.828824 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 19:28:41.828824 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 19:28:41.828824 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 19:28:41.828824 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 19:28:41.828824 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 19:28:41.828824 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:28:41.828824 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 19:28:41.828824 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:28:41.828824 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:41.828824 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:41.828824 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:41.828824 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:41.828824 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:41.830170 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:41.830170 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:41.830170 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:41.830170 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:41.830170 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:41.830170 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:41.830170 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 19:28:41.830170 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 19:28:41.830170 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 19:28:41.830170 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 19:28:41.830170 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:41.830170 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:41.830170 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:41.830170 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:41.830170 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:41.830170 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:41.831018 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:41.831018 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:41.831018 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:41.831018 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:41.831018 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:41.831018 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:41.831018 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:41.831018 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:41.831018 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:41.831018 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:41.831018 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 19:28:41.831018 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 19:28:41.831018 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 19:28:41.831018 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:28:41.834804 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 325/660] 10.222.0.23 () {56 vars in 1105 bytes} [Thu Aug 18 19:28:41 2022] GET /identity/v3/services/image => generated 86 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:28:41.835918 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c61fe0d-5a07-4c8b-ba57-67002ef756a9 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:41.915044 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e682bb4e-788e-4961-9d5a-d20aefeb0001 None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:41.958684 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c61fe0d-5a07-4c8b-ba57-67002ef756a9 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:41.959088 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a19e314-0ece-4357-ad92-f97ddc0af624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:41.959723 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a19e314-0ece-4357-ad92-f97ddc0af624 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:41.960255 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a19e314-0ece-4357-ad92-f97ddc0af624 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:41.960533 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a19e314-0ece-4357-ad92-f97ddc0af624 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:41.962089 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a19e314-0ece-4357-ad92-f97ddc0af624 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:41.963499 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a19e314-0ece-4357-ad92-f97ddc0af624 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:41.975970 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application [None req-6a19e314-0ece-4357-ad92-f97ddc0af624 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 19:28:41.975970 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:41.975970 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 19:28:41.975970 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 19:28:41.975970 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 19:28:41.975970 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 19:28:41.975970 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 19:28:41.975970 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 19:28:41.975970 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 19:28:41.975970 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:28:41.975970 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 19:28:41.975970 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:28:41.975970 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:41.975970 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:41.975970 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:41.975970 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:41.975970 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:41.976968 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:41.976968 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:41.976968 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:41.976968 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:41.976968 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:41.976968 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:41.976968 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 19:28:41.976968 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 19:28:41.976968 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 19:28:41.976968 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 19:28:41.976968 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:41.976968 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:41.976968 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:41.976968 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:41.976968 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:41.976968 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:41.977817 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:41.977817 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:41.977817 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:41.977817 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:41.977817 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:41.977817 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:41.977817 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:41.977817 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:41.977817 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:41.977817 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:41.977817 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 19:28:41.977817 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 19:28:41.977817 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 19:28:41.977817 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:28:41.977817 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 336/661] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Aug 18 19:28:41 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 19:28:41.978605 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a19e314-0ece-4357-ad92-f97ddc0af624 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:42.002191 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aff94cd-8caa-4137-85b8-86274d693203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:42.002802 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aff94cd-8caa-4137-85b8-86274d693203 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:42.003082 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aff94cd-8caa-4137-85b8-86274d693203 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:42.003347 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aff94cd-8caa-4137-85b8-86274d693203 None admin] PATH_INFO: `/v3/services` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:42.003974 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aff94cd-8caa-4137-85b8-86274d693203 None admin] RBAC: Adding query filter params (name=image) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:42.004278 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aff94cd-8caa-4137-85b8-86274d693203 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:42.005642 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aff94cd-8caa-4137-85b8-86274d693203 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:42.010798 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 326/662] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Aug 18 19:28:41 2022] GET /identity/v3/services?name=image => generated 122 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:42.011572 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aff94cd-8caa-4137-85b8-86274d693203 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:42.075286 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:42.081151 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:42.095331 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a19e314-0ece-4357-ad92-f97ddc0af624 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:42.124104 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aff94cd-8caa-4137-85b8-86274d693203 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:42.130678 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cebd21-88b0-4242-a42d-ee46d3031958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:42.131343 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cebd21-88b0-4242-a42d-ee46d3031958 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:42.131814 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cebd21-88b0-4242-a42d-ee46d3031958 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:42.132355 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cebd21-88b0-4242-a42d-ee46d3031958 None admin] PATH_INFO: `/v3/services/network` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:42.133003 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cebd21-88b0-4242-a42d-ee46d3031958 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:42.134498 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cebd21-88b0-4242-a42d-ee46d3031958 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:42.143536 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application [None req-07cebd21-88b0-4242-a42d-ee46d3031958 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 19:28:42.143536 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:42.143536 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 19:28:42.143536 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 19:28:42.143536 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 19:28:42.143536 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 19:28:42.143536 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 19:28:42.143536 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 19:28:42.143536 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 19:28:42.143536 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:28:42.143536 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 19:28:42.143536 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:28:42.143536 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:42.143536 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:42.143536 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:42.143536 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:42.143536 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:42.144497 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:42.144497 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:42.144497 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:42.144497 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:42.144497 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:42.144497 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:42.144497 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 19:28:42.144497 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 19:28:42.144497 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 19:28:42.144497 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 19:28:42.144497 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:42.144497 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:42.144497 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:42.144497 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:42.144497 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:42.144497 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:42.145321 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:42.145321 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:42.145321 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:42.145321 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:42.145321 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:42.145321 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:42.145321 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:42.145321 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:42.145321 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:42.145321 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:42.145321 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 19:28:42.145321 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 19:28:42.145321 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 19:28:42.145321 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:28:42.145321 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 337/663] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Aug 18 19:28:41 2022] GET /identity/v3/services/network => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:28:42.146162 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cebd21-88b0-4242-a42d-ee46d3031958 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:42.167261 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea955c3-b475-4072-9fcf-1f33e7099583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:42.168262 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea955c3-b475-4072-9fcf-1f33e7099583 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:42.169573 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea955c3-b475-4072-9fcf-1f33e7099583 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:42.170048 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea955c3-b475-4072-9fcf-1f33e7099583 None admin] PATH_INFO: `/v3/services` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:42.170817 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea955c3-b475-4072-9fcf-1f33e7099583 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:42.171261 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea955c3-b475-4072-9fcf-1f33e7099583 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:42.173471 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea955c3-b475-4072-9fcf-1f33e7099583 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:42.178365 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 327/664] 10.222.0.23 () {56 vars in 1124 bytes} [Thu Aug 18 19:28:42 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:42.179298 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea955c3-b475-4072-9fcf-1f33e7099583 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:42.258525 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cebd21-88b0-4242-a42d-ee46d3031958 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:42.284374 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea955c3-b475-4072-9fcf-1f33e7099583 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:42.297519 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b89e84c-dded-40af-856c-49c3bebb7e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:42.298176 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b89e84c-dded-40af-856c-49c3bebb7e77 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:42.298459 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b89e84c-dded-40af-856c-49c3bebb7e77 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:42.298734 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b89e84c-dded-40af-856c-49c3bebb7e77 None admin] PATH_INFO: `/v3/services` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:42.299369 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b89e84c-dded-40af-856c-49c3bebb7e77 None admin] RBAC: Adding query filter params (type=image) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:42.299675 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b89e84c-dded-40af-856c-49c3bebb7e77 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:42.301048 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b89e84c-dded-40af-856c-49c3bebb7e77 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:42.308989 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:42.313877 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 338/665] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Aug 18 19:28:42 2022] GET /identity/v3/services?type=image => generated 122 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:42.315235 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b89e84c-dded-40af-856c-49c3bebb7e77 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:42.331064 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52468e2-6b37-4627-b792-2aa2732db8a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:42.331705 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52468e2-6b37-4627-b792-2aa2732db8a8 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:42.331991 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52468e2-6b37-4627-b792-2aa2732db8a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:42.332270 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52468e2-6b37-4627-b792-2aa2732db8a8 None admin] PATH_INFO: `/v3/services` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:42.333869 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:42.334180 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52468e2-6b37-4627-b792-2aa2732db8a8 None admin] RBAC: Adding query filter params (name=network) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:42.334898 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52468e2-6b37-4627-b792-2aa2732db8a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:42.337723 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52468e2-6b37-4627-b792-2aa2732db8a8 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:42.345313 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 328/666] 10.222.0.23 () {56 vars in 1112 bytes} [Thu Aug 18 19:28:42 2022] GET /identity/v3/services?name=network => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:42.350787 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52468e2-6b37-4627-b792-2aa2732db8a8 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:42.443647 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b89e84c-dded-40af-856c-49c3bebb7e77 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:42.483087 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153f8176-765b-4b23-a557-bc6c85e92913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:42.484098 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153f8176-765b-4b23-a557-bc6c85e92913 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:42.484588 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153f8176-765b-4b23-a557-bc6c85e92913 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:42.485066 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153f8176-765b-4b23-a557-bc6c85e92913 None admin] PATH_INFO: `/v3/services` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:42.485916 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153f8176-765b-4b23-a557-bc6c85e92913 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:42.486414 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153f8176-765b-4b23-a557-bc6c85e92913 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:42.487976 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153f8176-765b-4b23-a557-bc6c85e92913 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:42.493473 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 339/667] 10.222.0.23 () {56 vars in 1124 bytes} [Thu Aug 18 19:28:42 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:42.499352 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52468e2-6b37-4627-b792-2aa2732db8a8 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:42.543626 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f45a234-e127-40cf-b7d1-d6dc014190c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:42.544616 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f45a234-e127-40cf-b7d1-d6dc014190c2 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:42.545099 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f45a234-e127-40cf-b7d1-d6dc014190c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:42.545593 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f45a234-e127-40cf-b7d1-d6dc014190c2 None admin] PATH_INFO: `/v3/services` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:42.546519 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f45a234-e127-40cf-b7d1-d6dc014190c2 None admin] RBAC: Adding query filter params (type=network) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:42.547026 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f45a234-e127-40cf-b7d1-d6dc014190c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:42.548701 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f45a234-e127-40cf-b7d1-d6dc014190c2 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:42.555890 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 329/668] 10.222.0.23 () {56 vars in 1112 bytes} [Thu Aug 18 19:28:42 2022] GET /identity/v3/services?type=network => generated 124 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:28:43.383664 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3706006e-f856-46ca-9077-b1ab3b3ce594 None None] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:43.384589 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3706006e-f856-46ca-9077-b1ab3b3ce594 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:43.385092 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3706006e-f856-46ca-9077-b1ab3b3ce594 None None] PATH_INFO: `/` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:43.386907 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 340/669] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:28:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:28:43.392436 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb850ec-7e72-44b5-b71f-4e6410304c0e None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:43.393233 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb850ec-7e72-44b5-b71f-4e6410304c0e None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:43.393760 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb850ec-7e72-44b5-b71f-4e6410304c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:43.412359 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-9eb850ec-7e72-44b5-b71f-4e6410304c0e None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:28:43.414022 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-9eb850ec-7e72-44b5-b71f-4e6410304c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:28:43.463259 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:43.485082 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 330/670] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:28:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:28:43.827846 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3706006e-f856-46ca-9077-b1ab3b3ce594 None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:43.909324 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:43.937225 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3706006e-f856-46ca-9077-b1ab3b3ce594 None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:43.974247 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2ded7c-034b-4841-b8ef-7f9565963379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:43.975218 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2ded7c-034b-4841-b8ef-7f9565963379 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:43.975703 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2ded7c-034b-4841-b8ef-7f9565963379 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:43.976186 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2ded7c-034b-4841-b8ef-7f9565963379 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:43.987176 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2ded7c-034b-4841-b8ef-7f9565963379 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:28:43.992648 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application [None req-7a2ded7c-034b-4841-b8ef-7f9565963379 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 19:28:43.992648 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:43.992648 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:43.992648 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:43.992648 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:43.992648 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:43.992648 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:43.992648 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:43.992648 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:43.992648 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:43.992648 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:43.992648 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:43.992648 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:28:43.992648 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:28:43.992648 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:28:43.992648 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:28:43.993585 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:28:43.993585 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:28:43.993585 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:28:43.993585 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:28:43.993585 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:43.993585 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:43.993585 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:43.993585 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:43.993585 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:43.993585 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:43.993585 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:43.993585 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:43.993585 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:43.993585 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:43.993585 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:43.993585 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:43.994614 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:43.994614 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:43.994614 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:43.994614 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:43.994614 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:28:43.994614 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:28:43.994614 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:28:43.994614 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:28:43.994614 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:28:43.994614 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:28:43.994614 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 19:28:43.994614 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:28:43.996912 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 341/671] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Aug 18 19:28:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:28:44.002469 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb850ec-7e72-44b5-b71f-4e6410304c0e None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:44.109291 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb850ec-7e72-44b5-b71f-4e6410304c0e None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:44.144875 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ba12be-9e58-49a2-ae58-dbeae970e05a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:44.145485 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ba12be-9e58-49a2-ae58-dbeae970e05a None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:44.145797 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ba12be-9e58-49a2-ae58-dbeae970e05a None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:44.146070 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ba12be-9e58-49a2-ae58-dbeae970e05a None admin] PATH_INFO: `/v3/roles` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:44.146732 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ba12be-9e58-49a2-ae58-dbeae970e05a None admin] RBAC: Adding query filter params (name=admin) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:44.147041 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ba12be-9e58-49a2-ae58-dbeae970e05a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:44.148396 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ba12be-9e58-49a2-ae58-dbeae970e05a None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:44.161765 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 331/672] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Aug 18 19:28:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:44.163874 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2ded7c-034b-4841-b8ef-7f9565963379 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:44.271868 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2ded7c-034b-4841-b8ef-7f9565963379 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:44.306877 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e0d34c-96a1-4dae-82e7-4ac5df37d54b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:44.307507 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e0d34c-96a1-4dae-82e7-4ac5df37d54b None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:44.307786 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e0d34c-96a1-4dae-82e7-4ac5df37d54b None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:44.308060 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e0d34c-96a1-4dae-82e7-4ac5df37d54b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:44.310580 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:44.320227 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e0d34c-96a1-4dae-82e7-4ac5df37d54b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:44.325515 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e0d34c-96a1-4dae-82e7-4ac5df37d54b None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:44.337251 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application [None req-14e0d34c-96a1-4dae-82e7-4ac5df37d54b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:28:44.337251 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:44.337251 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:44.337251 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:44.337251 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:44.337251 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:44.337251 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:44.337251 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:44.337251 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:44.337251 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:44.337251 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:44.337251 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:44.337251 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 19:28:44.337251 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 19:28:44.337251 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 19:28:44.337251 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 19:28:44.338267 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:44.338267 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:44.338267 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:44.338267 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:44.338267 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:44.338267 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:44.338267 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:44.338267 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:44.338267 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:44.338267 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:44.338267 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:44.338267 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:44.338267 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:44.338267 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:44.338267 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:44.338267 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:44.338267 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 19:28:44.339151 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 19:28:44.339151 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:28:44.339151 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:28:44.339151 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 342/673] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Aug 18 19:28:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:28:44.344299 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ba12be-9e58-49a2-ae58-dbeae970e05a None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:44.392579 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:44.448731 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ba12be-9e58-49a2-ae58-dbeae970e05a None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:44.490801 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f94008-c751-4329-bfc3-304d024a737f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:44.491423 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f94008-c751-4329-bfc3-304d024a737f None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:44.491706 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f94008-c751-4329-bfc3-304d024a737f None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:44.491976 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f94008-c751-4329-bfc3-304d024a737f None admin] PATH_INFO: `/v3/domains` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:44.492617 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f94008-c751-4329-bfc3-304d024a737f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:44.492920 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f94008-c751-4329-bfc3-304d024a737f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:44.494322 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f94008-c751-4329-bfc3-304d024a737f None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:44.507599 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 332/674] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Aug 18 19:28:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:44.513746 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e0d34c-96a1-4dae-82e7-4ac5df37d54b None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:44.618916 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e0d34c-96a1-4dae-82e7-4ac5df37d54b None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:44.623516 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e32ac-c516-4075-80ea-17dde5e351bc None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:44.623801 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e32ac-c516-4075-80ea-17dde5e351bc None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:44.624070 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e32ac-c516-4075-80ea-17dde5e351bc None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:44.625535 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 333/675] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:28:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 19:28:44.630255 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aac47f-27bb-4b0a-852e-ab677e19315a None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:44.630539 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aac47f-27bb-4b0a-852e-ab677e19315a None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:44.630812 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aac47f-27bb-4b0a-852e-ab677e19315a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:44.649542 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-18aac47f-27bb-4b0a-852e-ab677e19315a None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:28:44.650707 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-18aac47f-27bb-4b0a-852e-ab677e19315a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:28:44.672564 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f330d0-9f75-41a2-ae1f-bd288ac38cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:44.673798 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f330d0-9f75-41a2-ae1f-bd288ac38cf2 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:44.674273 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f330d0-9f75-41a2-ae1f-bd288ac38cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:44.675541 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f330d0-9f75-41a2-ae1f-bd288ac38cf2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:44.688332 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f330d0-9f75-41a2-ae1f-bd288ac38cf2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:44.691106 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f330d0-9f75-41a2-ae1f-bd288ac38cf2 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:44.704068 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application [None req-99f330d0-9f75-41a2-ae1f-bd288ac38cf2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 18 19:28:44.704068 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:44.704068 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:44.704068 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:44.704068 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:44.704068 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:44.704068 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:44.704068 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:44.704068 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:44.704068 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:44.704068 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:44.704068 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:44.704068 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 19:28:44.704068 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 19:28:44.704068 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 19:28:44.704068 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 19:28:44.705287 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:44.705287 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:44.705287 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 19:28:44.705287 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 19:28:44.705287 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 19:28:44.705287 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 19:28:44.705287 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:44.705287 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:44.705287 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:44.705287 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:44.705287 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:44.705287 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:44.705287 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:44.705287 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:44.705287 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:44.705287 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:44.705287 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:44.705287 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:44.706385 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:44.706385 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:44.706385 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 19:28:44.706385 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 19:28:44.706385 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 19:28:44.706385 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 19:28:44.706385 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 19:28:44.706385 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 19:28:44.706385 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 18 19:28:44.706385 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:28:44.706385 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 343/676] 10.222.0.23 () {56 vars in 1093 bytes} [Thu Aug 18 19:28:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 19:28:44.711567 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f330d0-9f75-41a2-ae1f-bd288ac38cf2 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:44.737775 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 334/677] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:28:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 19:28:44.767362 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:44.823660 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f330d0-9f75-41a2-ae1f-bd288ac38cf2 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:44.830403 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba5826-1c9d-4f0a-a8b7-460862555f4b None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:44.830697 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba5826-1c9d-4f0a-a8b7-460862555f4b None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:44.830976 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba5826-1c9d-4f0a-a8b7-460862555f4b None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:44.836566 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 335/678] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:28:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 19:28:44.838138 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1baedf1-bb6f-49d3-98e6-fb371ca20f12 None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:44.838423 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1baedf1-bb6f-49d3-98e6-fb371ca20f12 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:44.838693 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1baedf1-bb6f-49d3-98e6-fb371ca20f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:44.862119 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-f1baedf1-bb6f-49d3-98e6-fb371ca20f12 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:28:44.863310 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-f1baedf1-bb6f-49d3-98e6-fb371ca20f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:28:44.864563 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e279aa-7fac-4948-bc28-65e033075a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:44.865619 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e279aa-7fac-4948-bc28-65e033075a02 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:44.866159 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e279aa-7fac-4948-bc28-65e033075a02 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:44.867513 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e279aa-7fac-4948-bc28-65e033075a02 None admin] PATH_INFO: `/v3/users` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:44.868484 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e279aa-7fac-4948-bc28-65e033075a02 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:44.868937 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e279aa-7fac-4948-bc28-65e033075a02 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:44.870551 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e279aa-7fac-4948-bc28-65e033075a02 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:44.895537 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 344/679] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Aug 18 19:28:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:44.897013 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5967e979-063c-428a-8bdc-758f8e223260 None None] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:44.897489 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5967e979-063c-428a-8bdc-758f8e223260 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:44.897621 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:44.897819 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5967e979-063c-428a-8bdc-758f8e223260 None None] PATH_INFO: `/` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:44.899158 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 345/680] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:28:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:28:44.904483 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5967e979-063c-428a-8bdc-758f8e223260 None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:44.949840 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 336/681] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:28:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 19:28:44.949840 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216010bb-864f-4831-bab9-9b726c2f8b82 None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:44.949840 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216010bb-864f-4831-bab9-9b726c2f8b82 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:44.949840 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216010bb-864f-4831-bab9-9b726c2f8b82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:44.967027 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-216010bb-864f-4831-bab9-9b726c2f8b82 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:28:44.968522 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-216010bb-864f-4831-bab9-9b726c2f8b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:28:45.022594 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5967e979-063c-428a-8bdc-758f8e223260 None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:45.031368 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:45.044843 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 337/682] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:28:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 19:28:45.074170 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216010bb-864f-4831-bab9-9b726c2f8b82 None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:45.081264 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29c7186-93d5-4b4e-a67f-0305bff079a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:45.082327 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29c7186-93d5-4b4e-a67f-0305bff079a7 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:45.083069 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29c7186-93d5-4b4e-a67f-0305bff079a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:45.084256 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29c7186-93d5-4b4e-a67f-0305bff079a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:45.096885 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29c7186-93d5-4b4e-a67f-0305bff079a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:45.098878 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29c7186-93d5-4b4e-a67f-0305bff079a7 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:45.116363 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application [None req-e29c7186-93d5-4b4e-a67f-0305bff079a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:28:45.116363 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:45.116363 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:45.116363 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:45.116363 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:45.116363 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:45.116363 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:45.116363 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:45.116363 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:45.116363 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:45.116363 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:45.116363 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:45.116363 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 19:28:45.116363 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 19:28:45.116363 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 19:28:45.116363 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 19:28:45.117562 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:45.117562 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:45.117562 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:45.117562 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:45.117562 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:45.117562 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:45.117562 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:45.117562 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:45.117562 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:45.117562 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:45.117562 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:45.117562 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:45.117562 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:45.117562 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:45.117562 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:45.117562 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:45.117562 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 19:28:45.118711 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 19:28:45.118711 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:28:45.118711 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:28:45.119683 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 346/683] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Aug 18 19:28:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 19:28:45.127446 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29c7186-93d5-4b4e-a67f-0305bff079a7 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:45.188417 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:45.196036 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216010bb-864f-4831-bab9-9b726c2f8b82 None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:45.237392 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c90dfa5-0781-4624-8b00-d6dc0811ad3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:45.238363 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c90dfa5-0781-4624-8b00-d6dc0811ad3b None admin] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:45.238784 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c90dfa5-0781-4624-8b00-d6dc0811ad3b None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:45.239231 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c90dfa5-0781-4624-8b00-d6dc0811ad3b None admin] PATH_INFO: `/v3/services` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:45.240040 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c90dfa5-0781-4624-8b00-d6dc0811ad3b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:45.241591 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c90dfa5-0781-4624-8b00-d6dc0811ad3b None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:45.317272 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 338/684] 10.222.0.23 () {60 vars in 1141 bytes} [Thu Aug 18 19:28:45 2022] POST /identity/v3/services => generated 242 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 19:28:45.318613 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c90dfa5-0781-4624-8b00-d6dc0811ad3b None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:45.369820 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29c7186-93d5-4b4e-a67f-0305bff079a7 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:45.415884 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cfc5b1-0c4f-45f3-8a3b-f32d84bdf36b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:45.416541 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cfc5b1-0c4f-45f3-8a3b-f32d84bdf36b None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:45.416820 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cfc5b1-0c4f-45f3-8a3b-f32d84bdf36b None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:45.417089 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cfc5b1-0c4f-45f3-8a3b-f32d84bdf36b None admin] PATH_INFO: `/v3/domains` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:45.417766 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cfc5b1-0c4f-45f3-8a3b-f32d84bdf36b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:45.418068 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cfc5b1-0c4f-45f3-8a3b-f32d84bdf36b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:45.420089 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cfc5b1-0c4f-45f3-8a3b-f32d84bdf36b None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:45.435397 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 347/685] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Aug 18 19:28:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:28:45.435397 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cfc5b1-0c4f-45f3-8a3b-f32d84bdf36b None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:45.450164 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c90dfa5-0781-4624-8b00-d6dc0811ad3b None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:45.453869 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:45.490919 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d9b26f-3544-4a1f-b092-c454211e0c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:45.491677 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d9b26f-3544-4a1f-b092-c454211e0c6c None admin] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:45.491976 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d9b26f-3544-4a1f-b092-c454211e0c6c None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:45.492332 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d9b26f-3544-4a1f-b092-c454211e0c6c None admin] PATH_INFO: `/v3/services` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:45.492863 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d9b26f-3544-4a1f-b092-c454211e0c6c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:45.494302 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d9b26f-3544-4a1f-b092-c454211e0c6c None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:45.550758 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cfc5b1-0c4f-45f3-8a3b-f32d84bdf36b None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:45.577771 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 339/686] 10.222.0.23 () {60 vars in 1141 bytes} [Thu Aug 18 19:28:45 2022] POST /identity/v3/services => generated 240 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 19:28:45.579133 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d9b26f-3544-4a1f-b092-c454211e0c6c None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:45.595143 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012c364b-0028-4e3b-a2b2-a9076fbedde4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:45.599974 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012c364b-0028-4e3b-a2b2-a9076fbedde4 None admin] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:45.599974 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012c364b-0028-4e3b-a2b2-a9076fbedde4 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:45.599974 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012c364b-0028-4e3b-a2b2-a9076fbedde4 None admin] PATH_INFO: `/v3/services` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:45.599974 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012c364b-0028-4e3b-a2b2-a9076fbedde4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:45.599974 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012c364b-0028-4e3b-a2b2-a9076fbedde4 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:45.603901 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:45.701015 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d9b26f-3544-4a1f-b092-c454211e0c6c None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:45.705919 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 348/687] 10.222.0.23 () {60 vars in 1141 bytes} [Thu Aug 18 19:28:45 2022] POST /identity/v3/services => generated 251 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 19:28:45.766961 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4317d4c8-aaa8-48ae-9c66-7e4fd67315c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:45.767745 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4317d4c8-aaa8-48ae-9c66-7e4fd67315c1 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:45.768023 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4317d4c8-aaa8-48ae-9c66-7e4fd67315c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:45.768287 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4317d4c8-aaa8-48ae-9c66-7e4fd67315c1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:45.777164 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4317d4c8-aaa8-48ae-9c66-7e4fd67315c1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:45.779576 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4317d4c8-aaa8-48ae-9c66-7e4fd67315c1 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:45.792471 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application [None req-4317d4c8-aaa8-48ae-9c66-7e4fd67315c1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 19:28:45.792471 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:45.792471 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:45.792471 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:45.792471 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:45.792471 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:45.792471 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:45.792471 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:45.792471 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:45.792471 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:45.792471 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:45.792471 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:45.792471 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 19:28:45.792471 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 19:28:45.792471 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 19:28:45.793539 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 19:28:45.793539 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:45.793539 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:45.793539 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:45.793539 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:45.793539 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:45.793539 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:45.793539 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:45.793539 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:45.793539 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:45.793539 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:45.793539 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:45.793539 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:45.793539 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:45.793539 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:45.793539 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:45.793539 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:45.794954 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 19:28:45.794954 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 19:28:45.794954 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 19:28:45.794954 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 19:28:45.794954 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 19:28:45.794954 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 19:28:45.794954 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 19:28:45.794954 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:28:45.794954 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 340/688] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Aug 18 19:28:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:28:45.800231 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012c364b-0028-4e3b-a2b2-a9076fbedde4 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:45.880706 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:45.917357 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012c364b-0028-4e3b-a2b2-a9076fbedde4 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:45.953539 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea95457-f144-420c-bae4-4262ce44fcf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:45.954121 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea95457-f144-420c-bae4-4262ce44fcf9 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:45.954401 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea95457-f144-420c-bae4-4262ce44fcf9 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:45.954677 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea95457-f144-420c-bae4-4262ce44fcf9 None admin] PATH_INFO: `/v3/projects` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:45.955368 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea95457-f144-420c-bae4-4262ce44fcf9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:45.955677 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea95457-f144-420c-bae4-4262ce44fcf9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:45.957165 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea95457-f144-420c-bae4-4262ce44fcf9 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:45.970503 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 349/689] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Aug 18 19:28:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:45.976814 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4317d4c8-aaa8-48ae-9c66-7e4fd67315c1 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:46.051969 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:46.097098 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4317d4c8-aaa8-48ae-9c66-7e4fd67315c1 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:46.138028 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a3e8a4-731f-497c-8716-1091e2b54cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:46.138887 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a3e8a4-731f-497c-8716-1091e2b54cdf None admin] REQUEST_METHOD: `PUT` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:46.139217 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a3e8a4-731f-497c-8716-1091e2b54cdf None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:46.139490 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a3e8a4-731f-497c-8716-1091e2b54cdf None admin] PATH_INFO: `/v3/projects/a44b197c3aa0479092f4d77d2c791c39/users/9c3560e900d248bc93147ddce515365b/roles/33fe6be3baf44b969c8166af5142e0c7` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:46.141415 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a3e8a4-731f-497c-8716-1091e2b54cdf None admin] RBAC: Authorizing `identity:create_grant(project_id=a44b197c3aa0479092f4d77d2c791c39, user_id=9c3560e900d248bc93147ddce515365b, role_id=33fe6be3baf44b969c8166af5142e0c7)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:46.142991 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a3e8a4-731f-497c-8716-1091e2b54cdf None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:46.208128 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 341/690] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Aug 18 19:28:45 2022] PUT /identity/v3/projects/a44b197c3aa0479092f4d77d2c791c39/users/9c3560e900d248bc93147ddce515365b/roles/33fe6be3baf44b969c8166af5142e0c7 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 19:28:47.606621 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b2026b-522b-4451-ab96-f9af463b55c3 None None] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:47.607140 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b2026b-522b-4451-ab96-f9af463b55c3 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:47.607140 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b2026b-522b-4451-ab96-f9af463b55c3 None None] PATH_INFO: `/` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:47.608732 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 350/691] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:28:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:28:47.614077 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e69873-ef43-4a22-aee6-abd5f28b99a9 None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:47.614477 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e69873-ef43-4a22-aee6-abd5f28b99a9 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:47.614644 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e69873-ef43-4a22-aee6-abd5f28b99a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:47.632862 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-a9e69873-ef43-4a22-aee6-abd5f28b99a9 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:28:47.634087 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-a9e69873-ef43-4a22-aee6-abd5f28b99a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:28:47.709101 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 342/692] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:28:47 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 19:28:47.834710 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac6567-90dc-4311-9113-f22628088410 None None] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:47.835001 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac6567-90dc-4311-9113-f22628088410 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:47.835275 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac6567-90dc-4311-9113-f22628088410 None None] PATH_INFO: `/` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:47.837162 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 351/693] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:28:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:28:47.843198 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955d1a65-b1b7-4706-8f85-7e21891b6b1a None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:47.843486 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955d1a65-b1b7-4706-8f85-7e21891b6b1a None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:47.843764 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955d1a65-b1b7-4706-8f85-7e21891b6b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:47.863937 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-955d1a65-b1b7-4706-8f85-7e21891b6b1a None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:28:47.865067 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-955d1a65-b1b7-4706-8f85-7e21891b6b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:28:47.924690 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:47.936372 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 343/694] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:28:47 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 19:28:48.012451 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c380e8e-f5dc-4cc6-b104-70814b79409a None None] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:48.013021 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c380e8e-f5dc-4cc6-b104-70814b79409a None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:48.013471 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c380e8e-f5dc-4cc6-b104-70814b79409a None None] PATH_INFO: `/` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:48.015367 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 352/695] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:28:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:28:48.020841 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8979ce5d-ff15-4a5c-8e3a-06f2ab1c5be5 None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:48.021365 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8979ce5d-ff15-4a5c-8e3a-06f2ab1c5be5 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:48.021873 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8979ce5d-ff15-4a5c-8e3a-06f2ab1c5be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:48.041288 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-8979ce5d-ff15-4a5c-8e3a-06f2ab1c5be5 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:28:48.042859 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-8979ce5d-ff15-4a5c-8e3a-06f2ab1c5be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:28:48.046130 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c380e8e-f5dc-4cc6-b104-70814b79409a None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:48.131203 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 344/696] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:28:48 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 19:28:48.175915 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c380e8e-f5dc-4cc6-b104-70814b79409a None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:48.204185 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:48.212960 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20ebc1b-6dfc-410a-8f19-42371af8a025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:48.213857 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ebc1b-6dfc-410a-8f19-42371af8a025 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:48.214305 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ebc1b-6dfc-410a-8f19-42371af8a025 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:48.214800 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ebc1b-6dfc-410a-8f19-42371af8a025 None admin] PATH_INFO: `/v3/services/image` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:48.218710 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20ebc1b-6dfc-410a-8f19-42371af8a025 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:48.218710 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20ebc1b-6dfc-410a-8f19-42371af8a025 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:48.226250 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application [None req-a20ebc1b-6dfc-410a-8f19-42371af8a025 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 19:28:48.226250 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:48.226250 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 19:28:48.226250 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 19:28:48.226250 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 19:28:48.226250 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 19:28:48.226250 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 19:28:48.226250 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 19:28:48.226250 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 19:28:48.226250 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:28:48.226250 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 19:28:48.226250 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:28:48.226250 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:48.226250 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:48.226250 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:48.226250 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:48.226250 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:48.227313 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:48.227313 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:48.227313 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:48.227313 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:48.227313 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:48.227313 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:48.227313 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 19:28:48.227313 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 19:28:48.227313 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 19:28:48.227313 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 19:28:48.227313 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:48.227313 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:48.227313 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:48.227313 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:48.227313 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:48.227313 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:48.228164 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:48.228164 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:48.228164 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:48.228164 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:48.228164 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:48.228164 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:48.228164 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:48.228164 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:48.228164 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:48.228164 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:48.228164 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 19:28:48.228164 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 19:28:48.228164 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 19:28:48.228164 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:28:48.230518 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 353/697] 10.222.0.23 () {56 vars in 1105 bytes} [Thu Aug 18 19:28:48 2022] GET /identity/v3/services/image => generated 86 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 19:28:48.236680 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8979ce5d-ff15-4a5c-8e3a-06f2ab1c5be5 None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:48.273711 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20ebc1b-6dfc-410a-8f19-42371af8a025 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:48.362590 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8979ce5d-ff15-4a5c-8e3a-06f2ab1c5be5 None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:48.390837 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:48.391318 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20ebc1b-6dfc-410a-8f19-42371af8a025 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:48.409962 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb94bc73-d448-4822-ab0e-843f1b3bc089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:48.410971 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb94bc73-d448-4822-ab0e-843f1b3bc089 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:48.411259 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb94bc73-d448-4822-ab0e-843f1b3bc089 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:48.411533 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb94bc73-d448-4822-ab0e-843f1b3bc089 None admin] PATH_INFO: `/v3/services` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:48.412168 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb94bc73-d448-4822-ab0e-843f1b3bc089 None admin] RBAC: Adding query filter params (name=image) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:48.412471 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb94bc73-d448-4822-ab0e-843f1b3bc089 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:48.413880 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb94bc73-d448-4822-ab0e-843f1b3bc089 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:48.421700 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 345/698] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Aug 18 19:28:48 2022] GET /identity/v3/services?name=image => generated 122 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:28:48.427070 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb94bc73-d448-4822-ab0e-843f1b3bc089 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:48.438852 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e4f76d-ebb8-4b7a-88ab-57645c51b751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:48.439486 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e4f76d-ebb8-4b7a-88ab-57645c51b751 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:48.439765 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e4f76d-ebb8-4b7a-88ab-57645c51b751 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:48.440037 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e4f76d-ebb8-4b7a-88ab-57645c51b751 None admin] PATH_INFO: `/v3/services/network` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:48.440620 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e4f76d-ebb8-4b7a-88ab-57645c51b751 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:48.442033 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e4f76d-ebb8-4b7a-88ab-57645c51b751 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:48.452167 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application [None req-17e4f76d-ebb8-4b7a-88ab-57645c51b751 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 19:28:48.452167 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:48.452167 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 19:28:48.452167 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 19:28:48.452167 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 19:28:48.452167 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 19:28:48.452167 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 19:28:48.452167 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 19:28:48.452167 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 19:28:48.452167 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:28:48.452167 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 19:28:48.452167 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:28:48.452167 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:48.452167 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:48.452167 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:48.452167 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:48.452167 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:48.453168 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:48.453168 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:48.453168 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:48.453168 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:48.453168 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:48.453168 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:48.453168 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 19:28:48.453168 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 19:28:48.453168 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 19:28:48.453168 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 19:28:48.453168 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:48.453168 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:48.453168 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:48.453168 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:48.453168 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:48.453168 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:48.454053 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:48.454053 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:48.454053 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:48.454053 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:48.454053 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:48.454053 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:48.454053 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:48.454053 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:48.454053 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:48.454053 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:48.454053 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 19:28:48.454053 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 19:28:48.454053 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 19:28:48.454053 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:28:48.454053 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 354/699] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Aug 18 19:28:48 2022] GET /identity/v3/services/network => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 19:28:48.461463 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e4f76d-ebb8-4b7a-88ab-57645c51b751 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:48.519206 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:48.547737 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb94bc73-d448-4822-ab0e-843f1b3bc089 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:48.566518 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e4f76d-ebb8-4b7a-88ab-57645c51b751 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:48.581539 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99ac78b-f7d7-4e0e-9130-9b36a21c4216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:48.582179 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ac78b-f7d7-4e0e-9130-9b36a21c4216 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:48.582457 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ac78b-f7d7-4e0e-9130-9b36a21c4216 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:48.582736 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ac78b-f7d7-4e0e-9130-9b36a21c4216 None admin] PATH_INFO: `/v3/services` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:48.583352 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99ac78b-f7d7-4e0e-9130-9b36a21c4216 None admin] RBAC: Adding query filter params (type=image) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:48.583655 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99ac78b-f7d7-4e0e-9130-9b36a21c4216 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:48.585011 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99ac78b-f7d7-4e0e-9130-9b36a21c4216 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:48.590682 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 346/700] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Aug 18 19:28:48 2022] GET /identity/v3/services?type=image => generated 350 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:48.591395 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99ac78b-f7d7-4e0e-9130-9b36a21c4216 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:48.607762 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e19587-3116-415f-ba34-f317c1808c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:48.608367 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e19587-3116-415f-ba34-f317c1808c91 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:48.608644 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e19587-3116-415f-ba34-f317c1808c91 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:48.608914 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e19587-3116-415f-ba34-f317c1808c91 None admin] PATH_INFO: `/v3/services` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:48.609532 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e19587-3116-415f-ba34-f317c1808c91 None admin] RBAC: Adding query filter params (name=network) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:48.609859 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e19587-3116-415f-ba34-f317c1808c91 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:48.611228 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e19587-3116-415f-ba34-f317c1808c91 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:48.615656 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 355/701] 10.222.0.23 () {56 vars in 1112 bytes} [Thu Aug 18 19:28:48 2022] GET /identity/v3/services?name=network => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:48.616857 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060de07-dafa-461a-ac2d-3ccfbe71c9e2 None None] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:48.617141 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060de07-dafa-461a-ac2d-3ccfbe71c9e2 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:48.617404 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060de07-dafa-461a-ac2d-3ccfbe71c9e2 None None] PATH_INFO: `/` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:48.618754 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 356/702] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:28:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:28:48.619353 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a060de07-dafa-461a-ac2d-3ccfbe71c9e2 None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:48.646238 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:48.696436 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99ac78b-f7d7-4e0e-9130-9b36a21c4216 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:48.722094 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a060de07-dafa-461a-ac2d-3ccfbe71c9e2 None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:48.730322 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8054f5c7-06af-484a-a134-476e017f7308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:48.730987 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8054f5c7-06af-484a-a134-476e017f7308 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:48.731271 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8054f5c7-06af-484a-a134-476e017f7308 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:48.731540 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8054f5c7-06af-484a-a134-476e017f7308 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:48.732116 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8054f5c7-06af-484a-a134-476e017f7308 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:48.733467 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8054f5c7-06af-484a-a134-476e017f7308 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:48.741995 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application [None req-8054f5c7-06af-484a-a134-476e017f7308 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 19:28:48.741995 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:48.741995 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 19:28:48.741995 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 19:28:48.741995 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 19:28:48.741995 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 19:28:48.741995 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 19:28:48.741995 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 19:28:48.741995 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 19:28:48.741995 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:28:48.741995 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 19:28:48.741995 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:28:48.741995 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:48.741995 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:48.741995 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:48.741995 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:48.741995 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:48.742973 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:48.742973 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:48.742973 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:48.742973 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:48.742973 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:48.742973 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:48.742973 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 19:28:48.742973 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 19:28:48.742973 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 19:28:48.742973 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 19:28:48.742973 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:48.742973 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:48.742973 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:48.742973 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:48.742973 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:48.742973 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:48.743813 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:48.743813 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:48.743813 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:48.743813 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:48.743813 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:48.743813 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:48.743813 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:48.743813 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:48.743813 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:48.743813 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:48.743813 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 19:28:48.743813 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 19:28:48.743813 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 19:28:48.743813 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:28:48.744535 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:48.744607 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 347/703] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Aug 18 19:28:48 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:28:48.744607 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8054f5c7-06af-484a-a134-476e017f7308 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:48.758638 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc7df72-62f1-4c1e-b360-720edf745036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:48.759244 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc7df72-62f1-4c1e-b360-720edf745036 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:48.759519 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc7df72-62f1-4c1e-b360-720edf745036 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:48.759785 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc7df72-62f1-4c1e-b360-720edf745036 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:48.760473 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc7df72-62f1-4c1e-b360-720edf745036 None admin] RBAC: Adding query filter params (interface=public, service_id=6cbaad0d563b4afe86cded31f27d9aa0, region_id=RegionOne) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:48.760773 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc7df72-62f1-4c1e-b360-720edf745036 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:48.762734 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc7df72-62f1-4c1e-b360-720edf745036 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:48.769870 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 357/704] 10.222.0.23 () {56 vars in 1251 bytes} [Thu Aug 18 19:28:48 2022] GET /identity/v3/endpoints?service_id=6cbaad0d563b4afe86cded31f27d9aa0&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:48.771047 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a9640e-cd21-4179-aa97-c477e1198a5a None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:48.771324 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a9640e-cd21-4179-aa97-c477e1198a5a None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:48.771591 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a9640e-cd21-4179-aa97-c477e1198a5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:48.789425 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-86a9640e-cd21-4179-aa97-c477e1198a5a None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:28:48.791069 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-86a9640e-cd21-4179-aa97-c477e1198a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:28:48.847053 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8054f5c7-06af-484a-a134-476e017f7308 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:48.858438 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 358/705] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:28:48 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 19:28:48.859259 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a9640e-cd21-4179-aa97-c477e1198a5a None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:48.872189 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:48.894814 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9360dde-2e69-4c74-bc39-978a39d6164a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:48.895446 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9360dde-2e69-4c74-bc39-978a39d6164a None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:48.895723 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9360dde-2e69-4c74-bc39-978a39d6164a None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:48.896001 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9360dde-2e69-4c74-bc39-978a39d6164a None admin] PATH_INFO: `/v3/services` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:48.896700 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9360dde-2e69-4c74-bc39-978a39d6164a None admin] RBAC: Adding query filter params (type=network) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:48.896947 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9360dde-2e69-4c74-bc39-978a39d6164a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:48.898400 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9360dde-2e69-4c74-bc39-978a39d6164a None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:48.903552 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 348/706] 10.222.0.23 () {56 vars in 1112 bytes} [Thu Aug 18 19:28:48 2022] GET /identity/v3/services?type=network => generated 350 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:48.904346 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9360dde-2e69-4c74-bc39-978a39d6164a None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:48.992552 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a9640e-cd21-4179-aa97-c477e1198a5a None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:49.007323 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:49.011652 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9360dde-2e69-4c74-bc39-978a39d6164a None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:49.028749 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb343aaf-26dd-43fb-aeae-faf9d563f4db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:49.029358 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb343aaf-26dd-43fb-aeae-faf9d563f4db None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:49.029638 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb343aaf-26dd-43fb-aeae-faf9d563f4db None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:49.029939 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb343aaf-26dd-43fb-aeae-faf9d563f4db None admin] PATH_INFO: `/v3/services` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:49.030563 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb343aaf-26dd-43fb-aeae-faf9d563f4db None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:49.030868 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb343aaf-26dd-43fb-aeae-faf9d563f4db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:49.032236 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb343aaf-26dd-43fb-aeae-faf9d563f4db None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:49.036916 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 359/707] 10.222.0.23 () {56 vars in 1124 bytes} [Thu Aug 18 19:28:48 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:49.037721 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb343aaf-26dd-43fb-aeae-faf9d563f4db None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:49.055469 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f1abd6-34e5-4bab-943a-7ef34f7a7e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:49.056335 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f1abd6-34e5-4bab-943a-7ef34f7a7e97 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:49.056624 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f1abd6-34e5-4bab-943a-7ef34f7a7e97 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:49.056922 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f1abd6-34e5-4bab-943a-7ef34f7a7e97 None admin] PATH_INFO: `/v3/services` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:49.057905 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f1abd6-34e5-4bab-943a-7ef34f7a7e97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:49.065028 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f1abd6-34e5-4bab-943a-7ef34f7a7e97 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:49.082015 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 349/708] 10.222.0.23 () {56 vars in 1087 bytes} [Thu Aug 18 19:28:48 2022] GET /identity/v3/services => generated 1002 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 19:28:49.082015 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f1abd6-34e5-4bab-943a-7ef34f7a7e97 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:49.143806 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:49.150684 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb343aaf-26dd-43fb-aeae-faf9d563f4db None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:49.194316 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1454ea09-3219-4e67-84a7-ffe2ffa89e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:49.194937 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1454ea09-3219-4e67-84a7-ffe2ffa89e32 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:49.195216 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1454ea09-3219-4e67-84a7-ffe2ffa89e32 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:49.195488 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1454ea09-3219-4e67-84a7-ffe2ffa89e32 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:49.196481 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1454ea09-3219-4e67-84a7-ffe2ffa89e32 None admin] RBAC: Adding query filter params (interface=public, service_id=320f7495550b472a9a937d130dad4bd1, region_id=RegionOne) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:49.196481 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1454ea09-3219-4e67-84a7-ffe2ffa89e32 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:49.197925 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1454ea09-3219-4e67-84a7-ffe2ffa89e32 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:49.206191 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 360/709] 10.222.0.23 () {56 vars in 1251 bytes} [Thu Aug 18 19:28:49 2022] GET /identity/v3/endpoints?service_id=320f7495550b472a9a937d130dad4bd1&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:49.206191 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1454ea09-3219-4e67-84a7-ffe2ffa89e32 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:49.232217 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f1abd6-34e5-4bab-943a-7ef34f7a7e97 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:49.261830 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:49.274985 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34648e77-4e26-4cc7-8deb-f836c072cc4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:49.275593 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34648e77-4e26-4cc7-8deb-f836c072cc4a None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:49.275867 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34648e77-4e26-4cc7-8deb-f836c072cc4a None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:49.276135 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34648e77-4e26-4cc7-8deb-f836c072cc4a None admin] PATH_INFO: `/v3/services` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:49.276759 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34648e77-4e26-4cc7-8deb-f836c072cc4a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:49.277155 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34648e77-4e26-4cc7-8deb-f836c072cc4a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:49.278474 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34648e77-4e26-4cc7-8deb-f836c072cc4a None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:49.283774 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 350/710] 10.222.0.23 () {56 vars in 1124 bytes} [Thu Aug 18 19:28:49 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:49.284553 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34648e77-4e26-4cc7-8deb-f836c072cc4a None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:49.331143 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1454ea09-3219-4e67-84a7-ffe2ffa89e32 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:49.368629 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc92b04-6d1e-4f30-bec7-c3591ff7847a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:49.369747 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc92b04-6d1e-4f30-bec7-c3591ff7847a None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:49.370245 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc92b04-6d1e-4f30-bec7-c3591ff7847a None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:49.370744 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc92b04-6d1e-4f30-bec7-c3591ff7847a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:49.384910 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc92b04-6d1e-4f30-bec7-c3591ff7847a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:28:49.390161 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application [None req-bbc92b04-6d1e-4f30-bec7-c3591ff7847a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 19:28:49.390161 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:49.390161 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:49.390161 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:49.390161 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:49.390161 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:49.390161 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:49.390161 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:49.390161 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:49.390161 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:49.390161 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:49.390161 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:49.390161 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:28:49.390161 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:28:49.390161 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:28:49.390161 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:28:49.391277 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:28:49.391277 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:28:49.391277 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:28:49.391277 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:28:49.391277 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:49.391277 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:49.391277 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:49.391277 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:49.391277 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:49.391277 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:49.391277 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:49.391277 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:49.391277 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:49.391277 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:49.391277 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:49.391277 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:49.392338 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:49.392338 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:49.392338 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:49.392338 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:49.392338 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:28:49.392338 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:28:49.392338 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:28:49.392338 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:28:49.392338 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:28:49.392338 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:28:49.392338 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 19:28:49.392338 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:28:49.392338 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 361/711] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Aug 18 19:28:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:28:49.393049 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc92b04-6d1e-4f30-bec7-c3591ff7847a None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:49.405772 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34648e77-4e26-4cc7-8deb-f836c072cc4a None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:49.408956 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:49.442888 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992445ac-4435-47ef-9a35-942c0abe5d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:49.443496 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992445ac-4435-47ef-9a35-942c0abe5d9a None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:49.443881 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992445ac-4435-47ef-9a35-942c0abe5d9a None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:49.444150 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992445ac-4435-47ef-9a35-942c0abe5d9a None admin] PATH_INFO: `/v3/services` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:49.444866 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992445ac-4435-47ef-9a35-942c0abe5d9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:49.446469 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992445ac-4435-47ef-9a35-942c0abe5d9a None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:49.465691 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 351/712] 10.222.0.23 () {56 vars in 1087 bytes} [Thu Aug 18 19:28:49 2022] GET /identity/v3/services => generated 1002 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 19:28:49.465691 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992445ac-4435-47ef-9a35-942c0abe5d9a None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:49.500883 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc92b04-6d1e-4f30-bec7-c3591ff7847a None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:49.502992 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:49.553872 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6e5b79-37fb-4ea9-8a1f-7afee935af2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:49.554781 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e5b79-37fb-4ea9-8a1f-7afee935af2e None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:49.555064 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e5b79-37fb-4ea9-8a1f-7afee935af2e None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:49.555334 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e5b79-37fb-4ea9-8a1f-7afee935af2e None admin] PATH_INFO: `/v3/endpoints` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:49.556698 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6e5b79-37fb-4ea9-8a1f-7afee935af2e None admin] RBAC: Adding query filter params (interface=public, service_id=28e18ecfd3ca45b480b80c1f56c3449a, region_id=RegionOne) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:49.557014 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6e5b79-37fb-4ea9-8a1f-7afee935af2e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:49.558778 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6e5b79-37fb-4ea9-8a1f-7afee935af2e None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:49.569849 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 362/713] 10.222.0.23 () {56 vars in 1251 bytes} [Thu Aug 18 19:28:49 2022] GET /identity/v3/endpoints?service_id=28e18ecfd3ca45b480b80c1f56c3449a&interface=public®ion_id=RegionOne => generated 194 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:49.571497 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6e5b79-37fb-4ea9-8a1f-7afee935af2e None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:49.602103 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992445ac-4435-47ef-9a35-942c0abe5d9a None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:49.642707 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630d0e39-06b9-4eb0-bfd1-bd9c22c4fcc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:49.643338 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630d0e39-06b9-4eb0-bfd1-bd9c22c4fcc6 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:49.643620 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630d0e39-06b9-4eb0-bfd1-bd9c22c4fcc6 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:49.643891 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630d0e39-06b9-4eb0-bfd1-bd9c22c4fcc6 None admin] PATH_INFO: `/v3/roles` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:49.644561 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630d0e39-06b9-4eb0-bfd1-bd9c22c4fcc6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:49.644863 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630d0e39-06b9-4eb0-bfd1-bd9c22c4fcc6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:49.647477 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630d0e39-06b9-4eb0-bfd1-bd9c22c4fcc6 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:49.657042 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 352/714] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Aug 18 19:28:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:49.662571 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630d0e39-06b9-4eb0-bfd1-bd9c22c4fcc6 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:49.703553 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:49.719784 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6e5b79-37fb-4ea9-8a1f-7afee935af2e None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:49.770072 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9543cfa8-3d36-48a9-93b4-e71a596174f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:49.771206 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543cfa8-3d36-48a9-93b4-e71a596174f8 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:49.771700 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543cfa8-3d36-48a9-93b4-e71a596174f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:49.771977 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543cfa8-3d36-48a9-93b4-e71a596174f8 None admin] PATH_INFO: `/v3/services` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:49.772840 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9543cfa8-3d36-48a9-93b4-e71a596174f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:49.774898 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9543cfa8-3d36-48a9-93b4-e71a596174f8 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:49.780328 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630d0e39-06b9-4eb0-bfd1-bd9c22c4fcc6 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:49.788809 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 363/715] 10.222.0.23 () {56 vars in 1087 bytes} [Thu Aug 18 19:28:49 2022] GET /identity/v3/services => generated 1002 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 19:28:49.824695 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b50b0c-8365-45ec-a2f7-c83647c2267e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:49.825347 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b50b0c-8365-45ec-a2f7-c83647c2267e None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:49.825713 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b50b0c-8365-45ec-a2f7-c83647c2267e None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:49.825994 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b50b0c-8365-45ec-a2f7-c83647c2267e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:49.838988 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b50b0c-8365-45ec-a2f7-c83647c2267e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:49.841027 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b50b0c-8365-45ec-a2f7-c83647c2267e None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:49.860849 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application [None req-d5b50b0c-8365-45ec-a2f7-c83647c2267e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:28:49.860849 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:49.860849 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:49.860849 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:49.860849 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:49.860849 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:49.860849 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:49.860849 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:49.860849 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:49.860849 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:49.860849 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:49.860849 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:49.860849 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 19:28:49.860849 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 19:28:49.860849 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 19:28:49.860849 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 19:28:49.861925 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:49.861925 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:49.861925 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:49.861925 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:49.861925 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:49.861925 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:49.861925 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:49.861925 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:49.861925 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:49.861925 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:49.861925 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:49.861925 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:49.861925 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:49.861925 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:49.861925 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:49.861925 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:49.861925 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 19:28:49.863481 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 19:28:49.863481 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:28:49.863481 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:28:49.863481 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 353/716] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Aug 18 19:28:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 19:28:49.867984 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9543cfa8-3d36-48a9-93b4-e71a596174f8 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:49.904162 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:49.983385 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9543cfa8-3d36-48a9-93b4-e71a596174f8 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:50.021905 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d8d7fd-63f1-4438-9c5c-0a7bb9f13e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:50.022821 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d8d7fd-63f1-4438-9c5c-0a7bb9f13e08 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:50.023250 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d8d7fd-63f1-4438-9c5c-0a7bb9f13e08 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:50.023685 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d8d7fd-63f1-4438-9c5c-0a7bb9f13e08 None admin] PATH_INFO: `/v3/domains` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:50.024479 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d8d7fd-63f1-4438-9c5c-0a7bb9f13e08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:50.024923 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d8d7fd-63f1-4438-9c5c-0a7bb9f13e08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:50.026459 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d8d7fd-63f1-4438-9c5c-0a7bb9f13e08 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:50.039945 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 364/717] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Aug 18 19:28:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:50.045519 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b50b0c-8365-45ec-a2f7-c83647c2267e None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:50.139282 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:50.158590 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b50b0c-8365-45ec-a2f7-c83647c2267e None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:50.195882 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a9f8d9-9161-4ecf-b65b-e4d3d65b9579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:50.196574 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a9f8d9-9161-4ecf-b65b-e4d3d65b9579 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:50.196857 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a9f8d9-9161-4ecf-b65b-e4d3d65b9579 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:50.197139 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a9f8d9-9161-4ecf-b65b-e4d3d65b9579 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:50.205310 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a9f8d9-9161-4ecf-b65b-e4d3d65b9579 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:50.206856 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a9f8d9-9161-4ecf-b65b-e4d3d65b9579 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:50.220168 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application [None req-05a9f8d9-9161-4ecf-b65b-e4d3d65b9579 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 18 19:28:50.220168 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:50.220168 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:50.220168 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:50.220168 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:50.220168 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:50.220168 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:50.220168 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:50.220168 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:50.220168 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:50.220168 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:50.220168 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:50.220168 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 19:28:50.220168 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 19:28:50.220168 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 19:28:50.220168 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 19:28:50.221183 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:50.221183 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:50.221183 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 19:28:50.221183 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 19:28:50.221183 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 19:28:50.221183 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 19:28:50.221183 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:50.221183 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:50.221183 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:50.221183 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:50.221183 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:50.221183 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:50.221183 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:50.221183 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:50.221183 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:50.221183 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:50.221183 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:50.221183 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:50.222430 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:50.222430 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:50.222430 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 19:28:50.222430 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 19:28:50.222430 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 19:28:50.222430 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 19:28:50.222430 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 19:28:50.222430 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 19:28:50.222430 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 18 19:28:50.222430 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:28:50.222430 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 354/718] 10.222.0.23 () {56 vars in 1093 bytes} [Thu Aug 18 19:28:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 19:28:50.229243 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d8d7fd-63f1-4438-9c5c-0a7bb9f13e08 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:50.327033 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:50.338257 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d8d7fd-63f1-4438-9c5c-0a7bb9f13e08 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:50.377206 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0263f088-9600-4554-a7d8-e78c336b49b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:50.377855 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0263f088-9600-4554-a7d8-e78c336b49b6 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:50.378136 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0263f088-9600-4554-a7d8-e78c336b49b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:50.378407 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0263f088-9600-4554-a7d8-e78c336b49b6 None admin] PATH_INFO: `/v3/users` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:50.379123 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0263f088-9600-4554-a7d8-e78c336b49b6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:50.379417 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0263f088-9600-4554-a7d8-e78c336b49b6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:50.380830 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0263f088-9600-4554-a7d8-e78c336b49b6 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:50.399521 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 365/719] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Aug 18 19:28:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:50.405903 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a9f8d9-9161-4ecf-b65b-e4d3d65b9579 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:50.515748 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a9f8d9-9161-4ecf-b65b-e4d3d65b9579 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:50.551917 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f6a0c1-adc0-45fe-b0e4-4744f0af322e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:50.552535 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f6a0c1-adc0-45fe-b0e4-4744f0af322e None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:50.552814 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f6a0c1-adc0-45fe-b0e4-4744f0af322e None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:50.553081 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f6a0c1-adc0-45fe-b0e4-4744f0af322e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:50.566417 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:50.625085 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f6a0c1-adc0-45fe-b0e4-4744f0af322e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:50.626563 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f6a0c1-adc0-45fe-b0e4-4744f0af322e None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:50.733397 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 355/720] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Aug 18 19:28:50 2022] GET /identity/v3/auth/tokens => generated 1098 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 19:28:50.739823 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0263f088-9600-4554-a7d8-e78c336b49b6 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:50.850871 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0263f088-9600-4554-a7d8-e78c336b49b6 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:50.887466 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848e680b-c489-442a-9e4f-0d0c6ec3eb5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:50.888020 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848e680b-c489-442a-9e4f-0d0c6ec3eb5f None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:50.888296 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848e680b-c489-442a-9e4f-0d0c6ec3eb5f None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:50.888623 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848e680b-c489-442a-9e4f-0d0c6ec3eb5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:50.899687 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848e680b-c489-442a-9e4f-0d0c6ec3eb5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:50.901144 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848e680b-c489-442a-9e4f-0d0c6ec3eb5f None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:50.910041 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:50.916715 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application [None req-848e680b-c489-442a-9e4f-0d0c6ec3eb5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:28:50.916715 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:50.916715 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:50.916715 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:50.916715 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:50.916715 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:50.916715 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:50.916715 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:50.916715 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:50.916715 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:50.916715 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:50.916715 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:50.916715 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 19:28:50.916715 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 19:28:50.916715 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 19:28:50.916715 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 19:28:50.923845 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:50.923845 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:50.923845 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:50.923845 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:50.923845 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:50.923845 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:50.923845 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:50.923845 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:50.923845 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:50.923845 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:50.923845 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:50.923845 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:50.923845 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:50.923845 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:50.923845 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:50.923845 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:50.923845 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 19:28:50.924776 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 19:28:50.924776 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:28:50.924776 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:28:50.924776 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 366/721] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Aug 18 19:28:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:28:50.926741 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f6a0c1-adc0-45fe-b0e4-4744f0af322e None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:50.975111 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:51.036104 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f6a0c1-adc0-45fe-b0e4-4744f0af322e None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:51.082657 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98931249-2eb1-4fa2-919a-f539016d8cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:51.083508 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98931249-2eb1-4fa2-919a-f539016d8cc0 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:51.084076 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98931249-2eb1-4fa2-919a-f539016d8cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:51.084546 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98931249-2eb1-4fa2-919a-f539016d8cc0 None admin] PATH_INFO: `/v3/domains` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:51.085776 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98931249-2eb1-4fa2-919a-f539016d8cc0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:51.086318 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98931249-2eb1-4fa2-919a-f539016d8cc0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:51.087864 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98931249-2eb1-4fa2-919a-f539016d8cc0 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:51.105144 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 356/722] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Aug 18 19:28:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:51.107458 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848e680b-c489-442a-9e4f-0d0c6ec3eb5f None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:51.223622 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848e680b-c489-442a-9e4f-0d0c6ec3eb5f None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:51.264014 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b63a0bc-3926-493b-a395-7731a0d7de63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:51.264650 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b63a0bc-3926-493b-a395-7731a0d7de63 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:51.264931 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b63a0bc-3926-493b-a395-7731a0d7de63 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:51.265204 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b63a0bc-3926-493b-a395-7731a0d7de63 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:51.273373 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b63a0bc-3926-493b-a395-7731a0d7de63 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:51.274863 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b63a0bc-3926-493b-a395-7731a0d7de63 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:51.288313 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application [None req-0b63a0bc-3926-493b-a395-7731a0d7de63 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 19:28:51.288313 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:51.288313 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:51.288313 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:51.288313 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:51.288313 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:51.288313 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:51.288313 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:51.288313 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:51.288313 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:51.288313 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:51.288313 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:51.288313 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 19:28:51.288313 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 19:28:51.288313 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 19:28:51.289309 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 19:28:51.289309 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:51.289309 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:51.289309 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:51.289309 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:51.289309 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:51.289309 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:51.289309 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:51.289309 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:51.289309 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:51.289309 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:51.289309 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:51.289309 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:51.289309 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:51.289309 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:51.289309 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:51.289309 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:51.290271 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 19:28:51.290271 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 19:28:51.290271 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 19:28:51.290271 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 19:28:51.290271 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 19:28:51.290271 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 19:28:51.290271 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 19:28:51.290271 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:28:51.291260 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 367/723] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Aug 18 19:28:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:28:51.298144 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98931249-2eb1-4fa2-919a-f539016d8cc0 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:51.320612 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954e7ea7-4a83-499c-961a-f4e1c7ba001d None None] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:51.320921 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954e7ea7-4a83-499c-961a-f4e1c7ba001d None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:51.321183 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954e7ea7-4a83-499c-961a-f4e1c7ba001d None None] PATH_INFO: `/` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:51.322799 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 368/724] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:28:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:28:51.327781 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9a0f78-b40a-4c37-82d8-b19ab8504d59 None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:51.328101 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9a0f78-b40a-4c37-82d8-b19ab8504d59 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:51.328338 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9a0f78-b40a-4c37-82d8-b19ab8504d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:51.347143 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-3a9a0f78-b40a-4c37-82d8-b19ab8504d59 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:28:51.348334 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-3a9a0f78-b40a-4c37-82d8-b19ab8504d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:28:51.419421 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98931249-2eb1-4fa2-919a-f539016d8cc0 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:51.420975 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:51.433399 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:51.453796 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 369/725] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:28:51 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 19:28:51.462106 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84461d01-05f0-4701-a477-09a8c9eaad04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:51.462951 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84461d01-05f0-4701-a477-09a8c9eaad04 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:51.463393 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84461d01-05f0-4701-a477-09a8c9eaad04 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:51.463852 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84461d01-05f0-4701-a477-09a8c9eaad04 None admin] PATH_INFO: `/v3/projects` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:51.465314 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84461d01-05f0-4701-a477-09a8c9eaad04 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:51.465822 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84461d01-05f0-4701-a477-09a8c9eaad04 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:51.467405 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84461d01-05f0-4701-a477-09a8c9eaad04 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:51.485406 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 357/726] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Aug 18 19:28:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:51.487296 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9a0f78-b40a-4c37-82d8-b19ab8504d59 None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:51.595118 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9a0f78-b40a-4c37-82d8-b19ab8504d59 None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:51.636424 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1012fdf5-3172-4cb1-b6b1-fdecb5efb0cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:51.638017 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1012fdf5-3172-4cb1-b6b1-fdecb5efb0cd None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:51.638519 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1012fdf5-3172-4cb1-b6b1-fdecb5efb0cd None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:51.638985 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1012fdf5-3172-4cb1-b6b1-fdecb5efb0cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:51.639899 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1012fdf5-3172-4cb1-b6b1-fdecb5efb0cd None admin] RBAC: Adding query filter params (role.id=33fe6be3baf44b969c8166af5142e0c7, scope.project.id=a44b197c3aa0479092f4d77d2c791c39, user.id=9c3560e900d248bc93147ddce515365b) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:51.640405 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1012fdf5-3172-4cb1-b6b1-fdecb5efb0cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:51.642051 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1012fdf5-3172-4cb1-b6b1-fdecb5efb0cd None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:51.653765 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 370/727] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Aug 18 19:28:51 2022] GET /identity/v3/role_assignments?user.id=9c3560e900d248bc93147ddce515365b&scope.project.id=a44b197c3aa0479092f4d77d2c791c39&role.id=33fe6be3baf44b969c8166af5142e0c7 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:51.769917 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ada286a-bc15-418e-b39e-06d670c4e5bd None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:51.770413 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ada286a-bc15-418e-b39e-06d670c4e5bd None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:51.770413 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ada286a-bc15-418e-b39e-06d670c4e5bd None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:51.772013 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 358/728] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:28:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:28:51.778233 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d82df-893f-4df3-bbc2-858617f436d2 None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:51.778773 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d82df-893f-4df3-bbc2-858617f436d2 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:51.778773 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d82df-893f-4df3-bbc2-858617f436d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:51.785884 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ada286a-bc15-418e-b39e-06d670c4e5bd None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:51.800553 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-753d82df-893f-4df3-bbc2-858617f436d2 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:28:51.801958 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-753d82df-893f-4df3-bbc2-858617f436d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:28:51.872165 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:51.890346 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 371/729] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:28:51 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 19:28:51.910541 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ada286a-bc15-418e-b39e-06d670c4e5bd None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:51.947649 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47083ffb-312e-49f5-84c3-d5bc3de84b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:51.948304 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47083ffb-312e-49f5-84c3-d5bc3de84b21 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:51.948586 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47083ffb-312e-49f5-84c3-d5bc3de84b21 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:51.948862 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47083ffb-312e-49f5-84c3-d5bc3de84b21 None admin] PATH_INFO: `/v3/services/image` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:51.949495 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47083ffb-312e-49f5-84c3-d5bc3de84b21 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:51.950943 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47083ffb-312e-49f5-84c3-d5bc3de84b21 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:51.960834 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application [None req-47083ffb-312e-49f5-84c3-d5bc3de84b21 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 19:28:51.960834 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:51.960834 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 19:28:51.960834 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 19:28:51.960834 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 19:28:51.960834 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 19:28:51.960834 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 19:28:51.960834 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 19:28:51.960834 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 19:28:51.960834 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:28:51.960834 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 19:28:51.960834 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:28:51.960834 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:51.960834 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:51.960834 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:51.960834 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:51.960834 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:51.961874 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:51.961874 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:51.961874 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:51.961874 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:51.961874 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:51.961874 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:51.961874 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 19:28:51.961874 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 19:28:51.961874 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 19:28:51.961874 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 19:28:51.961874 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:51.961874 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:51.961874 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:51.961874 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:51.961874 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:51.961874 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:51.963344 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:51.963344 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:51.963344 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:51.963344 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:51.963344 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:51.963344 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:51.963344 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:51.963344 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:51.963344 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:51.963344 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:51.963344 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 19:28:51.963344 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 19:28:51.963344 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 19:28:51.963344 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:28:51.963344 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 359/730] 10.222.0.23 () {56 vars in 1105 bytes} [Thu Aug 18 19:28:51 2022] GET /identity/v3/services/image => generated 86 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:28:51.968596 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753d82df-893f-4df3-bbc2-858617f436d2 None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:52.082592 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753d82df-893f-4df3-bbc2-858617f436d2 None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:52.125027 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438f8a8d-babe-4928-bef0-8f6006252e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:52.126029 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f8a8d-babe-4928-bef0-8f6006252e00 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:52.126532 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f8a8d-babe-4928-bef0-8f6006252e00 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:52.127012 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f8a8d-babe-4928-bef0-8f6006252e00 None admin] PATH_INFO: `/v3/services` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:52.127987 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438f8a8d-babe-4928-bef0-8f6006252e00 None admin] RBAC: Adding query filter params (name=image) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:52.128618 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438f8a8d-babe-4928-bef0-8f6006252e00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:52.130261 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438f8a8d-babe-4928-bef0-8f6006252e00 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:52.138494 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 372/731] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Aug 18 19:28:51 2022] GET /identity/v3/services?name=image => generated 122 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:52.144297 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47083ffb-312e-49f5-84c3-d5bc3de84b21 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:52.176112 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:52.240522 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438f8a8d-babe-4928-bef0-8f6006252e00 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:52.254886 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47083ffb-312e-49f5-84c3-d5bc3de84b21 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:52.293615 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a4ca85-f1d6-4750-bbbf-dbd44cf7d603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:52.294254 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a4ca85-f1d6-4750-bbbf-dbd44cf7d603 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:52.294545 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a4ca85-f1d6-4750-bbbf-dbd44cf7d603 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:52.294817 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a4ca85-f1d6-4750-bbbf-dbd44cf7d603 None admin] PATH_INFO: `/v3/services` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:52.295451 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a4ca85-f1d6-4750-bbbf-dbd44cf7d603 None admin] RBAC: Adding query filter params (type=image) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:52.295590 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:52.295752 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a4ca85-f1d6-4750-bbbf-dbd44cf7d603 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:52.297332 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a4ca85-f1d6-4750-bbbf-dbd44cf7d603 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:52.308021 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 360/732] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Aug 18 19:28:52 2022] GET /identity/v3/services?type=image => generated 350 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:52.309428 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce172ad-24e5-4db2-ac1e-c52954258ea1 None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:52.309745 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce172ad-24e5-4db2-ac1e-c52954258ea1 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:52.310027 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce172ad-24e5-4db2-ac1e-c52954258ea1 None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:52.311449 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 361/733] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:28:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:28:52.311996 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce172ad-24e5-4db2-ac1e-c52954258ea1 None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:52.352118 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438f8a8d-babe-4928-bef0-8f6006252e00 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:52.390532 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fde661c-3cc1-4c59-a6f4-b8aff4a621ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:52.391182 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde661c-3cc1-4c59-a6f4-b8aff4a621ed None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:52.391460 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde661c-3cc1-4c59-a6f4-b8aff4a621ed None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:52.391734 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde661c-3cc1-4c59-a6f4-b8aff4a621ed None admin] PATH_INFO: `/v3/services/network` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:52.392320 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fde661c-3cc1-4c59-a6f4-b8aff4a621ed None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:52.393735 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fde661c-3cc1-4c59-a6f4-b8aff4a621ed None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:52.404021 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application [None req-0fde661c-3cc1-4c59-a6f4-b8aff4a621ed None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 19:28:52.404021 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:52.404021 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 19:28:52.404021 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 19:28:52.404021 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 19:28:52.404021 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 19:28:52.404021 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 19:28:52.404021 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 19:28:52.404021 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 19:28:52.404021 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:28:52.404021 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 19:28:52.404021 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:28:52.404021 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:52.404021 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:52.404021 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:52.404021 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:52.404021 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:52.405092 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:52.405092 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:52.405092 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:52.405092 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:52.405092 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:52.405092 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:52.405092 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 19:28:52.405092 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 19:28:52.405092 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 19:28:52.405092 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 19:28:52.405092 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:52.405092 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:52.405092 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:52.405092 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:52.405092 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:52.405092 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:52.406135 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:52.406135 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:52.406135 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:52.406135 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:52.406135 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:52.406135 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:52.406135 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:52.406135 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:52.406135 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:52.406135 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:52.406135 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 19:28:52.406135 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 19:28:52.406135 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 19:28:52.406135 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:28:52.409872 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 373/734] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Aug 18 19:28:52 2022] GET /identity/v3/services/network => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:28:52.411299 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a390ad9-64eb-4661-bd74-15cfbaf839df None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:52.411586 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a390ad9-64eb-4661-bd74-15cfbaf839df None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:52.411863 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a390ad9-64eb-4661-bd74-15cfbaf839df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:52.431410 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-7a390ad9-64eb-4661-bd74-15cfbaf839df None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:28:52.432625 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-7a390ad9-64eb-4661-bd74-15cfbaf839df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:28:52.506050 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 374/735] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:28:52 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 19:28:52.506888 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a390ad9-64eb-4661-bd74-15cfbaf839df None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:52.545059 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:52.559862 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:52.560872 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce172ad-24e5-4db2-ac1e-c52954258ea1 None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:52.602296 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2215a80d-3f0c-4371-80b8-d7490fd80f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:52.603044 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2215a80d-3f0c-4371-80b8-d7490fd80f2a None admin] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:52.603208 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2215a80d-3f0c-4371-80b8-d7490fd80f2a None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:52.603485 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2215a80d-3f0c-4371-80b8-d7490fd80f2a None admin] PATH_INFO: `/v3/endpoints` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:52.604303 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2215a80d-3f0c-4371-80b8-d7490fd80f2a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:52.605778 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2215a80d-3f0c-4371-80b8-d7490fd80f2a None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:52.627964 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a390ad9-64eb-4661-bd74-15cfbaf839df None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:52.663184 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3de2a28-c07c-4b22-a33b-f5cee3efc0dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:52.671506 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de2a28-c07c-4b22-a33b-f5cee3efc0dd None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:52.671506 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de2a28-c07c-4b22-a33b-f5cee3efc0dd None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:52.671506 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de2a28-c07c-4b22-a33b-f5cee3efc0dd None admin] PATH_INFO: `/v3/services` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:52.671506 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3de2a28-c07c-4b22-a33b-f5cee3efc0dd None admin] RBAC: Adding query filter params (name=network) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:52.671506 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3de2a28-c07c-4b22-a33b-f5cee3efc0dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:52.671506 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3de2a28-c07c-4b22-a33b-f5cee3efc0dd None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:52.671915 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 375/736] 10.222.0.23 () {56 vars in 1112 bytes} [Thu Aug 18 19:28:52 2022] GET /identity/v3/services?name=network => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:52.676540 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3de2a28-c07c-4b22-a33b-f5cee3efc0dd None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:52.729753 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 362/737] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Aug 18 19:28:52 2022] POST /identity/v3/endpoints => generated 327 bytes in 414 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 19:28:52.794047 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3de2a28-c07c-4b22-a33b-f5cee3efc0dd None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:52.803546 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:52.844656 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c37db6-3978-4557-8685-533c25478093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:52.845718 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c37db6-3978-4557-8685-533c25478093 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:52.846248 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c37db6-3978-4557-8685-533c25478093 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:52.846719 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c37db6-3978-4557-8685-533c25478093 None admin] PATH_INFO: `/v3/services` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:52.847577 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c37db6-3978-4557-8685-533c25478093 None admin] RBAC: Adding query filter params (type=network) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:52.848086 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c37db6-3978-4557-8685-533c25478093 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:52.849755 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c37db6-3978-4557-8685-533c25478093 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:52.856159 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 376/738] 10.222.0.23 () {56 vars in 1112 bytes} [Thu Aug 18 19:28:52 2022] GET /identity/v3/services?type=network => generated 350 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:28:52.861763 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2215a80d-3f0c-4371-80b8-d7490fd80f2a None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:52.866654 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c37db6-3978-4557-8685-533c25478093 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:52.988901 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2215a80d-3f0c-4371-80b8-d7490fd80f2a None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:53.024207 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c37db6-3978-4557-8685-533c25478093 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:53.033570 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c873a9-3993-44ca-91dc-30eec9bfeb79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:53.034225 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c873a9-3993-44ca-91dc-30eec9bfeb79 None admin] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:53.034503 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c873a9-3993-44ca-91dc-30eec9bfeb79 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:53.034777 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c873a9-3993-44ca-91dc-30eec9bfeb79 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:53.035453 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c873a9-3993-44ca-91dc-30eec9bfeb79 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:53.036816 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c873a9-3993-44ca-91dc-30eec9bfeb79 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:53.062174 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aae293-dc5d-40df-a1e4-7f6282243ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:53.063176 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aae293-dc5d-40df-a1e4-7f6282243ab9 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:53.063623 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aae293-dc5d-40df-a1e4-7f6282243ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:53.064123 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aae293-dc5d-40df-a1e4-7f6282243ab9 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:53.064865 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aae293-dc5d-40df-a1e4-7f6282243ab9 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:53.066410 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aae293-dc5d-40df-a1e4-7f6282243ab9 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:53.075762 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application [None req-b8aae293-dc5d-40df-a1e4-7f6282243ab9 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 19:28:53.075762 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:53.075762 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 19:28:53.075762 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 19:28:53.075762 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 19:28:53.075762 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 19:28:53.075762 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 19:28:53.075762 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 19:28:53.075762 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 19:28:53.075762 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:28:53.075762 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 19:28:53.075762 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:28:53.075762 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:53.075762 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:53.075762 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:53.075762 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:53.075762 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:53.078866 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:53.078866 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:53.078866 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:53.078866 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:53.078866 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:53.078866 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:53.078866 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 19:28:53.078866 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 19:28:53.078866 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 19:28:53.078866 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 19:28:53.078866 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:53.078866 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:53.078866 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:53.078866 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:53.078866 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:53.078866 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:53.079853 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:53.079853 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:53.079853 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:53.079853 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:53.079853 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:53.079853 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:53.079853 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:53.079853 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:53.079853 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:53.079853 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:53.079853 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 19:28:53.079853 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 19:28:53.079853 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 19:28:53.079853 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:28:53.079853 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 377/739] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Aug 18 19:28:52 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:28:53.082464 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aae293-dc5d-40df-a1e4-7f6282243ab9 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:53.114628 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:53.158297 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 363/740] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Aug 18 19:28:52 2022] POST /identity/v3/endpoints => generated 337 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 19:28:53.204589 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aae293-dc5d-40df-a1e4-7f6282243ab9 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:53.254560 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf62d44-8d22-44da-a71c-c21943d6967b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:53.255615 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf62d44-8d22-44da-a71c-c21943d6967b None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:53.256094 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf62d44-8d22-44da-a71c-c21943d6967b None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:53.257064 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf62d44-8d22-44da-a71c-c21943d6967b None admin] PATH_INFO: `/v3/services` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:53.258087 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf62d44-8d22-44da-a71c-c21943d6967b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:53.258597 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf62d44-8d22-44da-a71c-c21943d6967b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:53.260222 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf62d44-8d22-44da-a71c-c21943d6967b None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:53.266553 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 378/741] 10.222.0.23 () {56 vars in 1124 bytes} [Thu Aug 18 19:28:53 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:28:53.272156 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c873a9-3993-44ca-91dc-30eec9bfeb79 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:53.275429 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:53.394422 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c873a9-3993-44ca-91dc-30eec9bfeb79 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:53.433141 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346a3026-0597-454f-a4ca-307cdcabf8d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:53.433838 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a3026-0597-454f-a4ca-307cdcabf8d3 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:53.434104 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a3026-0597-454f-a4ca-307cdcabf8d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:53.434379 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a3026-0597-454f-a4ca-307cdcabf8d3 None admin] PATH_INFO: `/v3/services` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:53.435019 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346a3026-0597-454f-a4ca-307cdcabf8d3 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:53.435325 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346a3026-0597-454f-a4ca-307cdcabf8d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:53.436699 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346a3026-0597-454f-a4ca-307cdcabf8d3 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:53.442227 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 364/742] 10.222.0.23 () {56 vars in 1124 bytes} [Thu Aug 18 19:28:53 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:53.447616 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf62d44-8d22-44da-a71c-c21943d6967b None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:53.549886 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:53.559316 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf62d44-8d22-44da-a71c-c21943d6967b None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:53.593679 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110cbf82-ade1-4367-b88c-f5c7b3901284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:53.594292 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110cbf82-ade1-4367-b88c-f5c7b3901284 None admin] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:53.594568 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110cbf82-ade1-4367-b88c-f5c7b3901284 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:53.594835 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110cbf82-ade1-4367-b88c-f5c7b3901284 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:53.595550 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110cbf82-ade1-4367-b88c-f5c7b3901284 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:53.596914 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110cbf82-ade1-4367-b88c-f5c7b3901284 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:53.669908 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 379/743] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Aug 18 19:28:53 2022] POST /identity/v3/endpoints => generated 346 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 19:28:54.094551 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feb39d2-9b29-408e-aef1-6573967f6d1b None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:54.095031 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feb39d2-9b29-408e-aef1-6573967f6d1b None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:54.095143 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feb39d2-9b29-408e-aef1-6573967f6d1b None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:54.096423 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 365/744] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:28:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:28:54.101820 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417b0cc2-bbaf-4b67-a7e5-2bf95e1b40a2 None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:54.102221 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417b0cc2-bbaf-4b67-a7e5-2bf95e1b40a2 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:54.102385 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417b0cc2-bbaf-4b67-a7e5-2bf95e1b40a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:54.120536 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-417b0cc2-bbaf-4b67-a7e5-2bf95e1b40a2 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:28:54.122280 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-417b0cc2-bbaf-4b67-a7e5-2bf95e1b40a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:28:54.194155 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 380/745] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:28:54 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 19:28:54.526192 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feb39d2-9b29-408e-aef1-6573967f6d1b None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:54.593810 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:54.630561 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feb39d2-9b29-408e-aef1-6573967f6d1b None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:54.664325 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac4d48-d471-42bb-8747-6f5e88de7be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:54.664958 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac4d48-d471-42bb-8747-6f5e88de7be4 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:54.665263 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac4d48-d471-42bb-8747-6f5e88de7be4 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:54.665500 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac4d48-d471-42bb-8747-6f5e88de7be4 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:54.666108 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fac4d48-d471-42bb-8747-6f5e88de7be4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:54.667989 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fac4d48-d471-42bb-8747-6f5e88de7be4 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:54.677207 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application [None req-9fac4d48-d471-42bb-8747-6f5e88de7be4 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 19:28:54.677207 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:54.677207 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 19:28:54.677207 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 19:28:54.677207 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 19:28:54.677207 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 19:28:54.677207 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 19:28:54.677207 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 19:28:54.677207 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 19:28:54.677207 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:28:54.677207 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 19:28:54.677207 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:28:54.677207 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:54.677207 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:54.677207 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:54.677207 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:54.678348 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:54.678348 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:54.678348 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:54.678348 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:54.678348 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:54.678348 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:54.678348 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:54.678348 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 19:28:54.678348 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 19:28:54.678348 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 19:28:54.678348 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 19:28:54.678348 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:54.678348 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:54.678348 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:54.678348 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:54.678348 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:54.678348 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:54.679266 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:54.679266 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:54.679266 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:54.679266 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:54.679266 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:54.679266 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:54.679266 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:54.679266 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:54.679266 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:54.679266 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:54.679266 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 19:28:54.679266 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 19:28:54.679266 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 19:28:54.679266 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:28:54.680543 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 366/746] 10.222.0.23 () {56 vars in 1132 bytes} [Thu Aug 18 19:28:54 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:28:54.684853 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417b0cc2-bbaf-4b67-a7e5-2bf95e1b40a2 None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:54.758882 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:54.791135 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417b0cc2-bbaf-4b67-a7e5-2bf95e1b40a2 None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:54.826484 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae1154d-3f12-4dd8-8d6d-c186188c34a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:54.827119 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae1154d-3f12-4dd8-8d6d-c186188c34a1 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:54.827398 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae1154d-3f12-4dd8-8d6d-c186188c34a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:54.827670 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae1154d-3f12-4dd8-8d6d-c186188c34a1 None admin] PATH_INFO: `/v3/services` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:54.828295 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae1154d-3f12-4dd8-8d6d-c186188c34a1 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:54.828597 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae1154d-3f12-4dd8-8d6d-c186188c34a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:54.829997 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae1154d-3f12-4dd8-8d6d-c186188c34a1 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:54.834865 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 381/747] 10.222.0.23 () {56 vars in 1126 bytes} [Thu Aug 18 19:28:54 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:54.841122 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac4d48-d471-42bb-8747-6f5e88de7be4 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:54.946289 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac4d48-d471-42bb-8747-6f5e88de7be4 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:54.974834 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:54.981568 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4939d223-bd3e-45ee-9163-d45edf8f6919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:54.987478 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4939d223-bd3e-45ee-9163-d45edf8f6919 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:54.987478 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4939d223-bd3e-45ee-9163-d45edf8f6919 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:54.987478 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4939d223-bd3e-45ee-9163-d45edf8f6919 None admin] PATH_INFO: `/v3/services` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:54.987478 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4939d223-bd3e-45ee-9163-d45edf8f6919 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:54.987478 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4939d223-bd3e-45ee-9163-d45edf8f6919 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:54.987478 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4939d223-bd3e-45ee-9163-d45edf8f6919 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:54.997746 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 367/748] 10.222.0.23 () {56 vars in 1126 bytes} [Thu Aug 18 19:28:54 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:55.072533 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a9f7e-6dac-45ee-b725-402778e64dcd None None] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:55.072840 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a9f7e-6dac-45ee-b725-402778e64dcd None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:55.073085 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a9f7e-6dac-45ee-b725-402778e64dcd None None] PATH_INFO: `/` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:55.075690 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 382/749] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:28:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:28:55.080451 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c2d50b-be47-47ac-a531-e6ef19bd6b86 None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:55.080739 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c2d50b-be47-47ac-a531-e6ef19bd6b86 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:55.081016 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c2d50b-be47-47ac-a531-e6ef19bd6b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:55.101342 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-c6c2d50b-be47-47ac-a531-e6ef19bd6b86 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:28:55.102585 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-c6c2d50b-be47-47ac-a531-e6ef19bd6b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:28:55.177194 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 368/750] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:28:55 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 19:28:55.513015 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795a9f7e-6dac-45ee-b725-402778e64dcd None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:55.613592 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795a9f7e-6dac-45ee-b725-402778e64dcd None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:55.648149 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aea6535-f733-4c71-b2cd-1473ad3c0de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:55.648761 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aea6535-f733-4c71-b2cd-1473ad3c0de7 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:55.649066 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aea6535-f733-4c71-b2cd-1473ad3c0de7 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:55.649371 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aea6535-f733-4c71-b2cd-1473ad3c0de7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:55.652931 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:55.723093 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aea6535-f733-4c71-b2cd-1473ad3c0de7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:55.724582 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aea6535-f733-4c71-b2cd-1473ad3c0de7 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:55.822714 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 383/751] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Aug 18 19:28:55 2022] GET /identity/v3/auth/tokens => generated 1406 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 19:28:55.828890 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c2d50b-be47-47ac-a531-e6ef19bd6b86 None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:55.863690 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c6ba8d-6b3d-4076-b414-ff36fea60ab0 None None] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:55.863975 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c6ba8d-6b3d-4076-b414-ff36fea60ab0 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:55.864243 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c6ba8d-6b3d-4076-b414-ff36fea60ab0 None None] PATH_INFO: `/` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:55.865755 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 384/752] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:28:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:28:55.870380 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27803fd1-e8b3-4528-9eca-4a2799e60b57 None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:55.871197 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27803fd1-e8b3-4528-9eca-4a2799e60b57 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:55.871472 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27803fd1-e8b3-4528-9eca-4a2799e60b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:55.892482 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-27803fd1-e8b3-4528-9eca-4a2799e60b57 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:28:55.893690 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-27803fd1-e8b3-4528-9eca-4a2799e60b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:28:55.928127 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:55.934331 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c2d50b-be47-47ac-a531-e6ef19bd6b86 None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:55.957010 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:55.967667 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0859eaa2-118f-47e4-a25e-458b6fe6d9b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:55.968286 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0859eaa2-118f-47e4-a25e-458b6fe6d9b9 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:55.968633 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0859eaa2-118f-47e4-a25e-458b6fe6d9b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:55.968964 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0859eaa2-118f-47e4-a25e-458b6fe6d9b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:55.970680 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 385/753] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:28:55 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 19:28:55.979131 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0859eaa2-118f-47e4-a25e-458b6fe6d9b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:55.981129 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0859eaa2-118f-47e4-a25e-458b6fe6d9b9 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:55.996618 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application [None req-0859eaa2-118f-47e4-a25e-458b6fe6d9b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:28:55.996618 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:55.996618 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:55.996618 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:55.996618 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:55.996618 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:55.996618 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:55.996618 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:55.996618 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:55.996618 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:55.996618 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:55.996618 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:55.996618 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 19:28:55.996618 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 19:28:55.996618 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 19:28:55.996618 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 19:28:55.997569 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:55.997569 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:55.997569 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:55.997569 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:55.997569 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:55.997569 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:55.997569 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:55.997569 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:55.997569 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:55.997569 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:55.997569 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:55.997569 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:55.997569 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:55.997569 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:55.997569 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:55.997569 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:55.997569 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 19:28:55.998593 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 19:28:55.998593 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:28:55.998593 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:28:56.002003 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 369/754] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Aug 18 19:28:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:28:56.003660 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27803fd1-e8b3-4528-9eca-4a2799e60b57 None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:56.109892 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27803fd1-e8b3-4528-9eca-4a2799e60b57 None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:56.145470 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf8f986-b74f-439e-b978-c8f908166c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:56.146125 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf8f986-b74f-439e-b978-c8f908166c8d None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:56.146417 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf8f986-b74f-439e-b978-c8f908166c8d None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:56.146681 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf8f986-b74f-439e-b978-c8f908166c8d None admin] PATH_INFO: `/v3/domains` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:56.147311 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf8f986-b74f-439e-b978-c8f908166c8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:56.147614 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf8f986-b74f-439e-b978-c8f908166c8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:56.148973 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf8f986-b74f-439e-b978-c8f908166c8d None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:56.165699 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 386/755] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Aug 18 19:28:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:56.300459 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0859eaa2-118f-47e4-a25e-458b6fe6d9b9 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:56.410125 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0859eaa2-118f-47e4-a25e-458b6fe6d9b9 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:56.446254 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb9f86b-e4bb-4131-a9ac-5705e96d2c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:56.446895 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb9f86b-e4bb-4131-a9ac-5705e96d2c6e None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:56.447172 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb9f86b-e4bb-4131-a9ac-5705e96d2c6e None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:56.447444 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb9f86b-e4bb-4131-a9ac-5705e96d2c6e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:56.448022 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb9f86b-e4bb-4131-a9ac-5705e96d2c6e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:56.450186 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb9f86b-e4bb-4131-a9ac-5705e96d2c6e None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:56.459247 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application [None req-1bb9f86b-e4bb-4131-a9ac-5705e96d2c6e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 19:28:56.459247 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:56.459247 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 19:28:56.459247 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 19:28:56.459247 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 19:28:56.459247 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 19:28:56.459247 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 19:28:56.459247 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 19:28:56.459247 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 19:28:56.459247 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:28:56.459247 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 19:28:56.459247 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:28:56.459247 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:28:56.459247 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:28:56.459247 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:28:56.459247 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:28:56.459247 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:28:56.460704 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:28:56.460704 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:28:56.460704 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:28:56.460704 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:28:56.460704 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:28:56.460704 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:28:56.460704 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 19:28:56.460704 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 19:28:56.460704 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 19:28:56.460704 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 19:28:56.460704 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:28:56.460704 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:28:56.460704 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:28:56.460704 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:28:56.460704 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:28:56.460704 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:28:56.461816 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:28:56.461816 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application with Lock( Aug 18 19:28:56.461816 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:28:56.461816 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:28:56.461816 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:28:56.461816 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:28:56.461816 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:28:56.461816 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:28:56.461816 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:28:56.461816 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:28:56.461816 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 19:28:56.461816 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 19:28:56.461816 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 19:28:56.461816 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:28:56.465744 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 370/756] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Aug 18 19:28:56 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:28:56.466977 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf8f986-b74f-439e-b978-c8f908166c8d None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:56.496645 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:56.568631 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf8f986-b74f-439e-b978-c8f908166c8d None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:56.601673 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff62a31a-04c4-458d-95e4-85c9be5b698f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:56.602291 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff62a31a-04c4-458d-95e4-85c9be5b698f None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:56.602573 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff62a31a-04c4-458d-95e4-85c9be5b698f None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:56.602846 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff62a31a-04c4-458d-95e4-85c9be5b698f None admin] PATH_INFO: `/v3/services` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:56.603466 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff62a31a-04c4-458d-95e4-85c9be5b698f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:56.603767 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff62a31a-04c4-458d-95e4-85c9be5b698f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:56.605154 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff62a31a-04c4-458d-95e4-85c9be5b698f None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:56.609570 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 387/757] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Aug 18 19:28:56 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:56.615086 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb9f86b-e4bb-4131-a9ac-5705e96d2c6e None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:56.656648 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:56.715663 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb9f86b-e4bb-4131-a9ac-5705e96d2c6e None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:56.749806 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0013640f-db79-41d7-8c47-f7a598ae4b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:56.750412 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0013640f-db79-41d7-8c47-f7a598ae4b0a None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:56.750697 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0013640f-db79-41d7-8c47-f7a598ae4b0a None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:56.750975 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0013640f-db79-41d7-8c47-f7a598ae4b0a None admin] PATH_INFO: `/v3/services` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:56.751599 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0013640f-db79-41d7-8c47-f7a598ae4b0a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:28:56.751911 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0013640f-db79-41d7-8c47-f7a598ae4b0a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:56.753331 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0013640f-db79-41d7-8c47-f7a598ae4b0a None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:56.757704 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 371/758] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Aug 18 19:28:56 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:28:57.187370 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756858a7-0a9a-43d4-9f2a-187534637760 None None] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:57.187657 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756858a7-0a9a-43d4-9f2a-187534637760 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:57.187936 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756858a7-0a9a-43d4-9f2a-187534637760 None None] PATH_INFO: `/` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:57.189273 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 388/759] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:28:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:28:57.194531 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb44fe5a-ffc3-48eb-a769-db82da964d50 None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:57.194889 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb44fe5a-ffc3-48eb-a769-db82da964d50 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:57.195247 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb44fe5a-ffc3-48eb-a769-db82da964d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:57.213228 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-fb44fe5a-ffc3-48eb-a769-db82da964d50 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:28:57.214942 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-fb44fe5a-ffc3-48eb-a769-db82da964d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:28:57.280637 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 372/760] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:28:57 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 19:28:57.616475 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756858a7-0a9a-43d4-9f2a-187534637760 None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:57.705990 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:57.717126 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756858a7-0a9a-43d4-9f2a-187534637760 None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:57.750754 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92936cc-8403-4601-9fcc-f41c1c6aba9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:57.751367 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92936cc-8403-4601-9fcc-f41c1c6aba9b None admin] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:57.751657 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92936cc-8403-4601-9fcc-f41c1c6aba9b None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:57.751933 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92936cc-8403-4601-9fcc-f41c1c6aba9b None admin] PATH_INFO: `/v3/services` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:57.752570 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92936cc-8403-4601-9fcc-f41c1c6aba9b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:57.753972 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92936cc-8403-4601-9fcc-f41c1c6aba9b None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:57.830442 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 389/761] 10.222.0.23 () {60 vars in 1141 bytes} [Thu Aug 18 19:28:57 2022] POST /identity/v3/services => generated 269 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 19:28:58.913202 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a1aaeb-e630-4771-a382-8d5277b17abd None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:58.913769 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a1aaeb-e630-4771-a382-8d5277b17abd None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:58.913769 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a1aaeb-e630-4771-a382-8d5277b17abd None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:58.915092 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 373/762] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:28:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:28:58.921314 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e343ec6-e411-40fc-8526-21f542099d67 None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:58.921901 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e343ec6-e411-40fc-8526-21f542099d67 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:58.921901 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e343ec6-e411-40fc-8526-21f542099d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:58.940773 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-7e343ec6-e411-40fc-8526-21f542099d67 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:28:58.941996 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-7e343ec6-e411-40fc-8526-21f542099d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:28:59.013210 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 390/763] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:28:58 2022] POST /identity/v3/auth/tokens => generated 1516 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 19:28:59.337818 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a1aaeb-e630-4771-a382-8d5277b17abd None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:28:59.372903 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:28:59.438668 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a1aaeb-e630-4771-a382-8d5277b17abd None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:28:59.472851 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a672386-8f37-4080-a704-b1c63054fc5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:28:59.473925 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a672386-8f37-4080-a704-b1c63054fc5b None admin] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:28:59.474432 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a672386-8f37-4080-a704-b1c63054fc5b None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:28:59.474936 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a672386-8f37-4080-a704-b1c63054fc5b None admin] PATH_INFO: `/v3/services` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:28:59.476100 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a672386-8f37-4080-a704-b1c63054fc5b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:28:59.478646 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a672386-8f37-4080-a704-b1c63054fc5b None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:28:59.577191 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 374/764] 10.222.0.23 () {60 vars in 1141 bytes} [Thu Aug 18 19:28:59 2022] POST /identity/v3/services => generated 251 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 19:29:00.009314 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e29a2a6-9627-41d3-b82b-b1093a1dc03e None None] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:29:00.009882 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e29a2a6-9627-41d3-b82b-b1093a1dc03e None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:29:00.009882 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e29a2a6-9627-41d3-b82b-b1093a1dc03e None None] PATH_INFO: `/` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:29:00.011781 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 391/765] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:29:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:29:00.016988 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8e01fe-29f4-44ab-b7a9-7d6c39808be3 None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:29:00.017448 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8e01fe-29f4-44ab-b7a9-7d6c39808be3 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:29:00.017774 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8e01fe-29f4-44ab-b7a9-7d6c39808be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:29:00.036221 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-da8e01fe-29f4-44ab-b7a9-7d6c39808be3 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:29:00.037409 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-da8e01fe-29f4-44ab-b7a9-7d6c39808be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:29:00.113325 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 375/766] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:29:00 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 19:29:00.442005 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e29a2a6-9627-41d3-b82b-b1093a1dc03e None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:29:00.518404 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:29:00.541012 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e29a2a6-9627-41d3-b82b-b1093a1dc03e None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:29:00.575674 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51800a67-f2e7-4567-b39f-e08ce007120a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:29:00.576302 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51800a67-f2e7-4567-b39f-e08ce007120a None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:29:00.576581 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51800a67-f2e7-4567-b39f-e08ce007120a None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:29:00.576855 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51800a67-f2e7-4567-b39f-e08ce007120a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:29:00.577433 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51800a67-f2e7-4567-b39f-e08ce007120a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:29:00.578839 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51800a67-f2e7-4567-b39f-e08ce007120a None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:29:00.587809 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application [None req-51800a67-f2e7-4567-b39f-e08ce007120a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 19:29:00.587809 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:29:00.587809 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 19:29:00.587809 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 19:29:00.587809 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 19:29:00.587809 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 19:29:00.587809 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 19:29:00.587809 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 19:29:00.587809 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 19:29:00.587809 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:29:00.587809 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 19:29:00.587809 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:29:00.587809 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:29:00.587809 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:29:00.587809 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:29:00.587809 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:29:00.588736 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:29:00.588736 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:29:00.588736 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:29:00.588736 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:29:00.588736 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:29:00.588736 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:29:00.588736 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:29:00.588736 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 19:29:00.588736 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 19:29:00.588736 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 19:29:00.588736 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 19:29:00.588736 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:29:00.588736 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:29:00.588736 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:29:00.588736 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:29:00.588736 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:29:00.588736 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:29:00.589710 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:29:00.589710 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application with Lock( Aug 18 19:29:00.589710 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:29:00.589710 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:29:00.589710 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:29:00.589710 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:29:00.589710 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:29:00.589710 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:29:00.589710 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:29:00.589710 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:29:00.589710 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 19:29:00.589710 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 19:29:00.589710 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 19:29:00.589710 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:29:00.593722 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 392/767] 10.222.0.23 () {56 vars in 1132 bytes} [Thu Aug 18 19:29:00 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:29:00.594980 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8e01fe-29f4-44ab-b7a9-7d6c39808be3 None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:29:00.616150 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:29:00.694128 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8e01fe-29f4-44ab-b7a9-7d6c39808be3 None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:29:00.726908 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c45875-2e5a-46eb-92ea-5e3181cc7c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:29:00.727506 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c45875-2e5a-46eb-92ea-5e3181cc7c9b None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:29:00.727782 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c45875-2e5a-46eb-92ea-5e3181cc7c9b None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:29:00.728049 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c45875-2e5a-46eb-92ea-5e3181cc7c9b None admin] PATH_INFO: `/v3/services` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:29:00.728664 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c45875-2e5a-46eb-92ea-5e3181cc7c9b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:29:00.728970 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c45875-2e5a-46eb-92ea-5e3181cc7c9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:29:00.730887 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c45875-2e5a-46eb-92ea-5e3181cc7c9b None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:29:00.735409 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 376/768] 10.222.0.23 () {56 vars in 1126 bytes} [Thu Aug 18 19:29:00 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:29:00.741174 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51800a67-f2e7-4567-b39f-e08ce007120a None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:29:00.837799 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51800a67-f2e7-4567-b39f-e08ce007120a None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:29:00.870486 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aa58e6-b3b3-4658-b72a-94be45525d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:29:00.871073 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aa58e6-b3b3-4658-b72a-94be45525d3c None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:29:00.871348 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aa58e6-b3b3-4658-b72a-94be45525d3c None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:29:00.871618 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aa58e6-b3b3-4658-b72a-94be45525d3c None admin] PATH_INFO: `/v3/services` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:29:00.872231 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aa58e6-b3b3-4658-b72a-94be45525d3c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:29:00.872529 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aa58e6-b3b3-4658-b72a-94be45525d3c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:29:00.873904 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aa58e6-b3b3-4658-b72a-94be45525d3c None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:29:00.878464 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 393/769] 10.222.0.23 () {56 vars in 1126 bytes} [Thu Aug 18 19:29:00 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:29:00.884477 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c45875-2e5a-46eb-92ea-5e3181cc7c9b None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:29:00.965483 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:29:00.981002 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c45875-2e5a-46eb-92ea-5e3181cc7c9b None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:29:01.013607 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90100bdd-fb85-4fab-a12e-4da0d5ae7fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:29:01.014208 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90100bdd-fb85-4fab-a12e-4da0d5ae7fd4 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:29:01.014489 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90100bdd-fb85-4fab-a12e-4da0d5ae7fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:29:01.014762 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90100bdd-fb85-4fab-a12e-4da0d5ae7fd4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:29:01.015451 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90100bdd-fb85-4fab-a12e-4da0d5ae7fd4 None admin] RBAC: Adding query filter params (interface=public, service_id=a6ce33b3669843b1bbba88c1815e1b30, region_id=RegionOne) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:29:01.015759 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90100bdd-fb85-4fab-a12e-4da0d5ae7fd4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:29:01.017120 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90100bdd-fb85-4fab-a12e-4da0d5ae7fd4 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:29:01.024560 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 377/770] 10.222.0.23 () {56 vars in 1251 bytes} [Thu Aug 18 19:29:00 2022] GET /identity/v3/endpoints?service_id=a6ce33b3669843b1bbba88c1815e1b30&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:29:01.030435 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aa58e6-b3b3-4658-b72a-94be45525d3c None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:29:01.034547 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:29:01.139042 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aa58e6-b3b3-4658-b72a-94be45525d3c None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:29:01.172259 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8fb4ee-28b9-4ea7-9d2c-3858b2e8ef2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:29:01.172864 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8fb4ee-28b9-4ea7-9d2c-3858b2e8ef2e None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:29:01.173147 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8fb4ee-28b9-4ea7-9d2c-3858b2e8ef2e None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:29:01.173422 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8fb4ee-28b9-4ea7-9d2c-3858b2e8ef2e None admin] PATH_INFO: `/v3/services` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:29:01.174053 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8fb4ee-28b9-4ea7-9d2c-3858b2e8ef2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:29:01.175412 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8fb4ee-28b9-4ea7-9d2c-3858b2e8ef2e None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:29:01.181173 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 394/771] 10.222.0.23 () {56 vars in 1087 bytes} [Thu Aug 18 19:29:01 2022] GET /identity/v3/services => generated 1498 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 19:29:01.769191 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2da479-f113-47d4-bea9-4ab007064f0a None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:29:01.769475 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2da479-f113-47d4-bea9-4ab007064f0a None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:29:01.769787 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2da479-f113-47d4-bea9-4ab007064f0a None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:29:01.771255 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 378/772] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:29:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:29:01.776089 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472ad0f5-7628-47c7-80f8-b6ff76428bae None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:29:01.776374 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472ad0f5-7628-47c7-80f8-b6ff76428bae None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:29:01.776649 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472ad0f5-7628-47c7-80f8-b6ff76428bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:29:01.794420 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-472ad0f5-7628-47c7-80f8-b6ff76428bae None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:29:01.795586 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-472ad0f5-7628-47c7-80f8-b6ff76428bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:29:01.855361 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:29:01.860631 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 395/773] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:29:01 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 19:29:02.182464 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2da479-f113-47d4-bea9-4ab007064f0a None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:29:02.282403 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2da479-f113-47d4-bea9-4ab007064f0a None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:29:02.316448 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c41b6f-b7a1-4e2f-90cf-ee77a77824cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:29:02.317084 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c41b6f-b7a1-4e2f-90cf-ee77a77824cd None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:29:02.317407 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c41b6f-b7a1-4e2f-90cf-ee77a77824cd None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:29:02.317625 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c41b6f-b7a1-4e2f-90cf-ee77a77824cd None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:29:02.318226 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c41b6f-b7a1-4e2f-90cf-ee77a77824cd None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:29:02.319587 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c41b6f-b7a1-4e2f-90cf-ee77a77824cd None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:29:02.328229 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application [None req-b3c41b6f-b7a1-4e2f-90cf-ee77a77824cd None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 19:29:02.328229 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:29:02.328229 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 19:29:02.328229 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 19:29:02.328229 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 19:29:02.328229 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 19:29:02.328229 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 19:29:02.328229 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 19:29:02.328229 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 19:29:02.328229 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:29:02.328229 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 19:29:02.328229 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:29:02.328229 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:29:02.328229 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:29:02.328229 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:29:02.328229 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:29:02.328229 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:29:02.329200 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:29:02.329200 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:29:02.329200 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:29:02.329200 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:29:02.329200 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:29:02.329200 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:29:02.329200 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 19:29:02.329200 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 19:29:02.329200 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 19:29:02.329200 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 19:29:02.329200 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:29:02.329200 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:29:02.329200 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:29:02.329200 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:29:02.329200 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:29:02.329200 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:29:02.330642 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:29:02.330642 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application with Lock( Aug 18 19:29:02.330642 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:29:02.330642 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:29:02.330642 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:29:02.330642 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:29:02.330642 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:29:02.330642 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:29:02.330642 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:29:02.330642 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:29:02.330642 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 19:29:02.330642 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 19:29:02.330642 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 19:29:02.330642 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:29:02.330642 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 379/774] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Aug 18 19:29:02 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:29:02.335413 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472ad0f5-7628-47c7-80f8-b6ff76428bae None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:29:02.432700 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472ad0f5-7628-47c7-80f8-b6ff76428bae None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:29:02.465554 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a51c35-5df6-4d4e-869b-d712bf6b4ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:29:02.466182 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a51c35-5df6-4d4e-869b-d712bf6b4ea3 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:29:02.466461 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a51c35-5df6-4d4e-869b-d712bf6b4ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:29:02.466733 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a51c35-5df6-4d4e-869b-d712bf6b4ea3 None admin] PATH_INFO: `/v3/services` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:29:02.467348 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a51c35-5df6-4d4e-869b-d712bf6b4ea3 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:29:02.467646 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a51c35-5df6-4d4e-869b-d712bf6b4ea3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:29:02.469007 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a51c35-5df6-4d4e-869b-d712bf6b4ea3 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:29:02.473495 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 396/775] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Aug 18 19:29:02 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:29:02.479170 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c41b6f-b7a1-4e2f-90cf-ee77a77824cd None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:29:02.494732 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:29:02.578887 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c41b6f-b7a1-4e2f-90cf-ee77a77824cd None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:29:02.614399 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48639137-2f92-417d-97dc-03ec8bed034d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:29:02.615000 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48639137-2f92-417d-97dc-03ec8bed034d None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:29:02.615276 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48639137-2f92-417d-97dc-03ec8bed034d None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:29:02.615544 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48639137-2f92-417d-97dc-03ec8bed034d None admin] PATH_INFO: `/v3/services` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:29:02.616160 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48639137-2f92-417d-97dc-03ec8bed034d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:29:02.616536 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48639137-2f92-417d-97dc-03ec8bed034d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:29:02.617908 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48639137-2f92-417d-97dc-03ec8bed034d None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:29:02.622766 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 380/776] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Aug 18 19:29:02 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:29:02.628688 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a51c35-5df6-4d4e-869b-d712bf6b4ea3 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:29:02.689378 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:29:02.728297 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a51c35-5df6-4d4e-869b-d712bf6b4ea3 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:29:02.761151 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c138a104-6a69-4123-91d6-b4a4ff54e277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:29:02.761810 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c138a104-6a69-4123-91d6-b4a4ff54e277 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:29:02.762096 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c138a104-6a69-4123-91d6-b4a4ff54e277 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:29:02.762373 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c138a104-6a69-4123-91d6-b4a4ff54e277 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:29:02.763074 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c138a104-6a69-4123-91d6-b4a4ff54e277 None admin] RBAC: Adding query filter params (interface=public, service_id=59656aceb0344a19bc9009d9ae9c7057, region_id=RegionOne) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:29:02.763383 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c138a104-6a69-4123-91d6-b4a4ff54e277 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:29:02.764754 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c138a104-6a69-4123-91d6-b4a4ff54e277 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:29:02.774062 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 397/777] 10.222.0.23 () {56 vars in 1251 bytes} [Thu Aug 18 19:29:02 2022] GET /identity/v3/endpoints?service_id=59656aceb0344a19bc9009d9ae9c7057&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:29:02.775255 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48639137-2f92-417d-97dc-03ec8bed034d None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:29:02.850207 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:29:02.871695 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48639137-2f92-417d-97dc-03ec8bed034d None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:29:02.905622 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f0b7f0-09b6-436f-a3c4-04c1197deb5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:29:02.906279 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f0b7f0-09b6-436f-a3c4-04c1197deb5a None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:29:02.906556 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f0b7f0-09b6-436f-a3c4-04c1197deb5a None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:29:02.906827 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f0b7f0-09b6-436f-a3c4-04c1197deb5a None admin] PATH_INFO: `/v3/services` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:29:02.907420 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f0b7f0-09b6-436f-a3c4-04c1197deb5a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:29:02.908776 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f0b7f0-09b6-436f-a3c4-04c1197deb5a None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:29:02.914531 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 381/778] 10.222.0.23 () {56 vars in 1087 bytes} [Thu Aug 18 19:29:02 2022] GET /identity/v3/services => generated 1498 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 19:29:03.399449 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c948d04e-d208-4fee-97b7-ff1b9798bb70 None None] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:29:03.399995 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c948d04e-d208-4fee-97b7-ff1b9798bb70 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:29:03.400093 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c948d04e-d208-4fee-97b7-ff1b9798bb70 None None] PATH_INFO: `/` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:29:03.401836 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 398/779] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:29:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:29:03.406982 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a275905-ec4b-45ed-845f-0dc232ecaabb None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:29:03.407388 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a275905-ec4b-45ed-845f-0dc232ecaabb None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:29:03.407683 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a275905-ec4b-45ed-845f-0dc232ecaabb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:29:03.425857 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-7a275905-ec4b-45ed-845f-0dc232ecaabb None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:29:03.427036 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-7a275905-ec4b-45ed-845f-0dc232ecaabb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:29:03.491753 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 382/780] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:29:03 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 19:29:03.817711 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c948d04e-d208-4fee-97b7-ff1b9798bb70 None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:29:03.915122 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c948d04e-d208-4fee-97b7-ff1b9798bb70 None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:29:03.940209 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:29:03.948648 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c52bc3a-22c0-4d3e-96ac-c4260000c21a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:29:03.949271 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c52bc3a-22c0-4d3e-96ac-c4260000c21a None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:29:03.949545 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c52bc3a-22c0-4d3e-96ac-c4260000c21a None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:29:03.949840 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c52bc3a-22c0-4d3e-96ac-c4260000c21a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:29:03.950411 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c52bc3a-22c0-4d3e-96ac-c4260000c21a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:29:03.951817 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c52bc3a-22c0-4d3e-96ac-c4260000c21a None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:29:03.960570 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application [None req-0c52bc3a-22c0-4d3e-96ac-c4260000c21a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 19:29:03.960570 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:29:03.960570 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 19:29:03.960570 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 19:29:03.960570 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 19:29:03.960570 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 19:29:03.960570 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 19:29:03.960570 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 19:29:03.960570 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 19:29:03.960570 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:29:03.960570 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 19:29:03.960570 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:29:03.960570 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:29:03.960570 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:29:03.960570 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:29:03.960570 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:29:03.962411 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:29:03.962411 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:29:03.962411 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:29:03.962411 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:29:03.962411 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:29:03.962411 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:29:03.962411 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:29:03.962411 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 19:29:03.962411 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 19:29:03.962411 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 19:29:03.962411 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 19:29:03.962411 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:29:03.962411 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:29:03.962411 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:29:03.962411 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:29:03.962411 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:29:03.962411 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:29:03.964751 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:29:03.964751 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application with Lock( Aug 18 19:29:03.964751 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:29:03.964751 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:29:03.964751 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:29:03.964751 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:29:03.964751 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:29:03.964751 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:29:03.964751 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:29:03.964751 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:29:03.964751 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 19:29:03.964751 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 19:29:03.964751 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 19:29:03.964751 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:29:03.964751 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 399/781] 10.222.0.23 () {56 vars in 1132 bytes} [Thu Aug 18 19:29:03 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:29:03.968467 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a275905-ec4b-45ed-845f-0dc232ecaabb None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:29:04.038537 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:29:04.072688 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a275905-ec4b-45ed-845f-0dc232ecaabb None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:29:04.107619 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b10c67-030e-4e51-9b9c-783318295c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:29:04.108221 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b10c67-030e-4e51-9b9c-783318295c00 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:29:04.108501 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b10c67-030e-4e51-9b9c-783318295c00 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:29:04.108771 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b10c67-030e-4e51-9b9c-783318295c00 None admin] PATH_INFO: `/v3/services` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:29:04.109384 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b10c67-030e-4e51-9b9c-783318295c00 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:29:04.109703 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b10c67-030e-4e51-9b9c-783318295c00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:29:04.111087 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b10c67-030e-4e51-9b9c-783318295c00 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:29:04.115605 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 383/782] 10.222.0.23 () {56 vars in 1126 bytes} [Thu Aug 18 19:29:03 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:29:04.121432 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c52bc3a-22c0-4d3e-96ac-c4260000c21a None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:29:04.219434 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c52bc3a-22c0-4d3e-96ac-c4260000c21a None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:29:04.251419 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7a4f45-167c-4724-b1ab-7234a5337d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:29:04.252009 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7a4f45-167c-4724-b1ab-7234a5337d14 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:29:04.252286 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7a4f45-167c-4724-b1ab-7234a5337d14 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:29:04.252556 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7a4f45-167c-4724-b1ab-7234a5337d14 None admin] PATH_INFO: `/v3/services` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:29:04.253169 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7a4f45-167c-4724-b1ab-7234a5337d14 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:29:04.253468 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7a4f45-167c-4724-b1ab-7234a5337d14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:29:04.254855 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7a4f45-167c-4724-b1ab-7234a5337d14 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:29:04.259494 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 400/783] 10.222.0.23 () {56 vars in 1126 bytes} [Thu Aug 18 19:29:04 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:29:04.265783 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b10c67-030e-4e51-9b9c-783318295c00 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:29:04.363259 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b10c67-030e-4e51-9b9c-783318295c00 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:29:04.396479 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3e7149-bb89-4348-a263-44d61167bb29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:29:04.397078 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3e7149-bb89-4348-a263-44d61167bb29 None admin] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:29:04.397353 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3e7149-bb89-4348-a263-44d61167bb29 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:29:04.397620 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3e7149-bb89-4348-a263-44d61167bb29 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:29:04.398296 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3e7149-bb89-4348-a263-44d61167bb29 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:29:04.399638 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3e7149-bb89-4348-a263-44d61167bb29 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:29:04.404621 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:29:04.485880 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 384/784] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Aug 18 19:29:04 2022] POST /identity/v3/endpoints => generated 347 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 19:29:05.089755 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4123bb-5ee6-4a55-b0d8-6507977b302f None None] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:29:05.090269 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4123bb-5ee6-4a55-b0d8-6507977b302f None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:29:05.090376 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4123bb-5ee6-4a55-b0d8-6507977b302f None None] PATH_INFO: `/` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:29:05.091624 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 401/785] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:29:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:29:05.096776 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bec3279-c71f-48e3-8cdf-b48342b1488e None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:29:05.097132 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bec3279-c71f-48e3-8cdf-b48342b1488e None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:29:05.097476 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bec3279-c71f-48e3-8cdf-b48342b1488e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:29:05.115550 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-4bec3279-c71f-48e3-8cdf-b48342b1488e None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:29:05.116728 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-4bec3279-c71f-48e3-8cdf-b48342b1488e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:29:05.187738 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 385/786] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:29:05 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 19:29:05.526284 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4123bb-5ee6-4a55-b0d8-6507977b302f None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:29:05.582193 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:29:05.628531 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4123bb-5ee6-4a55-b0d8-6507977b302f None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:29:05.661080 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad0fead-541b-4da4-a7e1-f5187343017c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:29:05.661720 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad0fead-541b-4da4-a7e1-f5187343017c None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:29:05.662000 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad0fead-541b-4da4-a7e1-f5187343017c None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:29:05.662270 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad0fead-541b-4da4-a7e1-f5187343017c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:29:05.662840 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad0fead-541b-4da4-a7e1-f5187343017c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:29:05.664194 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad0fead-541b-4da4-a7e1-f5187343017c None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:29:05.673044 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application [None req-0ad0fead-541b-4da4-a7e1-f5187343017c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 19:29:05.673044 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:29:05.673044 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 19:29:05.673044 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 19:29:05.673044 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 19:29:05.673044 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 19:29:05.673044 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 19:29:05.673044 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 19:29:05.673044 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 19:29:05.673044 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:29:05.673044 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 19:29:05.673044 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:29:05.673044 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:29:05.673044 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:29:05.673044 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:29:05.673044 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:29:05.673044 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:29:05.674246 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:29:05.674246 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:29:05.674246 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:29:05.674246 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:29:05.674246 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:29:05.674246 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:29:05.674246 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 19:29:05.674246 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 19:29:05.674246 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 19:29:05.674246 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 19:29:05.674246 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:29:05.674246 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:29:05.674246 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:29:05.674246 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:29:05.674246 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:29:05.674246 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:29:05.675299 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:29:05.675299 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application with Lock( Aug 18 19:29:05.675299 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:29:05.675299 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:29:05.675299 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:29:05.675299 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:29:05.675299 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:29:05.675299 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:29:05.675299 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:29:05.675299 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:29:05.675299 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 19:29:05.675299 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 19:29:05.675299 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 19:29:05.675299 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:29:05.677818 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 402/787] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Aug 18 19:29:05 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:29:05.679931 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bec3279-c71f-48e3-8cdf-b48342b1488e None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:29:05.775024 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bec3279-c71f-48e3-8cdf-b48342b1488e None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:29:05.791197 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:29:05.808996 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ed3b44-92f9-455c-a9bf-227c588591ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:29:05.809592 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ed3b44-92f9-455c-a9bf-227c588591ff None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:29:05.809897 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ed3b44-92f9-455c-a9bf-227c588591ff None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:29:05.810201 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ed3b44-92f9-455c-a9bf-227c588591ff None admin] PATH_INFO: `/v3/services` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:29:05.810811 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ed3b44-92f9-455c-a9bf-227c588591ff None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:29:05.811107 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ed3b44-92f9-455c-a9bf-227c588591ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:29:05.812438 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ed3b44-92f9-455c-a9bf-227c588591ff None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:29:05.816873 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 386/788] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Aug 18 19:29:05 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:29:05.822604 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad0fead-541b-4da4-a7e1-f5187343017c None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:29:05.920452 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad0fead-541b-4da4-a7e1-f5187343017c None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:29:05.937599 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:29:05.954570 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc59fdb0-d8c0-486e-aa64-80df6ef7cc06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:29:05.955170 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc59fdb0-d8c0-486e-aa64-80df6ef7cc06 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:29:05.955446 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc59fdb0-d8c0-486e-aa64-80df6ef7cc06 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:29:05.955716 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc59fdb0-d8c0-486e-aa64-80df6ef7cc06 None admin] PATH_INFO: `/v3/services` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:29:05.956332 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc59fdb0-d8c0-486e-aa64-80df6ef7cc06 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:29:05.956631 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc59fdb0-d8c0-486e-aa64-80df6ef7cc06 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:29:05.958018 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc59fdb0-d8c0-486e-aa64-80df6ef7cc06 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:29:05.963129 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 403/789] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Aug 18 19:29:05 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:29:05.968953 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ed3b44-92f9-455c-a9bf-227c588591ff None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:29:06.071073 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ed3b44-92f9-455c-a9bf-227c588591ff None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:29:06.105381 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e80f28-3a70-4d12-93bc-abe4bcc12896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:29:06.106018 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e80f28-3a70-4d12-93bc-abe4bcc12896 None admin] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:29:06.106294 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e80f28-3a70-4d12-93bc-abe4bcc12896 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:29:06.106559 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e80f28-3a70-4d12-93bc-abe4bcc12896 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:29:06.107214 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e80f28-3a70-4d12-93bc-abe4bcc12896 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:29:06.108565 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e80f28-3a70-4d12-93bc-abe4bcc12896 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:29:06.211839 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 387/790] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Aug 18 19:29:05 2022] POST /identity/v3/endpoints => generated 346 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 19:29:06.656544 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817aa430-0368-4b53-b8cd-a1f6ec751c7a None None] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:29:06.657067 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817aa430-0368-4b53-b8cd-a1f6ec751c7a None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:29:06.657173 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817aa430-0368-4b53-b8cd-a1f6ec751c7a None None] PATH_INFO: `/` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:29:06.658480 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 404/791] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:29:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:29:06.663689 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0c457f-6047-4e39-86e6-aa2cc84126ee None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:29:06.663978 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0c457f-6047-4e39-86e6-aa2cc84126ee None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:29:06.664257 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0c457f-6047-4e39-86e6-aa2cc84126ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:29:06.681928 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-ba0c457f-6047-4e39-86e6-aa2cc84126ee None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:29:06.683110 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-ba0c457f-6047-4e39-86e6-aa2cc84126ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:29:06.711638 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:29:06.757771 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 388/792] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:29:06 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 19:29:07.093934 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817aa430-0368-4b53-b8cd-a1f6ec751c7a None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:29:07.193793 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817aa430-0368-4b53-b8cd-a1f6ec751c7a None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:29:07.227768 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6f754d-7c98-4217-8c59-596f693b0de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:29:07.228396 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6f754d-7c98-4217-8c59-596f693b0de2 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:29:07.228673 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6f754d-7c98-4217-8c59-596f693b0de2 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:29:07.228964 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6f754d-7c98-4217-8c59-596f693b0de2 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:29:07.229540 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6f754d-7c98-4217-8c59-596f693b0de2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:29:07.230929 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6f754d-7c98-4217-8c59-596f693b0de2 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:29:07.239501 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application [None req-3f6f754d-7c98-4217-8c59-596f693b0de2 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 19:29:07.239501 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:29:07.239501 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 19:29:07.239501 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 19:29:07.239501 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 19:29:07.239501 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 19:29:07.239501 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 19:29:07.239501 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 19:29:07.239501 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 19:29:07.239501 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:29:07.239501 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 19:29:07.239501 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:29:07.239501 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:29:07.239501 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:29:07.239501 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:29:07.239501 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:29:07.239501 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:29:07.240686 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:29:07.240686 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:29:07.240686 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:29:07.240686 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:29:07.240686 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:29:07.240686 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:29:07.240686 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 19:29:07.240686 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 19:29:07.240686 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 19:29:07.240686 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 19:29:07.240686 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:29:07.240686 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:29:07.240686 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:29:07.240686 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:29:07.240686 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:29:07.240686 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:29:07.241779 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:29:07.241779 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application with Lock( Aug 18 19:29:07.241779 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:29:07.241779 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:29:07.241779 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:29:07.241779 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:29:07.241779 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:29:07.241779 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:29:07.241779 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:29:07.241779 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:29:07.241779 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 19:29:07.241779 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 19:29:07.241779 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 19:29:07.241779 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:29:07.243022 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 405/793] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Aug 18 19:29:07 2022] GET /identity/v3/services/compute => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:29:07.246469 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0c457f-6047-4e39-86e6-aa2cc84126ee None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:29:07.345812 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0c457f-6047-4e39-86e6-aa2cc84126ee None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:29:07.379587 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c079eb41-72a8-459e-ac8a-95d47046ad47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:29:07.380190 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c079eb41-72a8-459e-ac8a-95d47046ad47 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:29:07.380508 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c079eb41-72a8-459e-ac8a-95d47046ad47 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:29:07.380786 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c079eb41-72a8-459e-ac8a-95d47046ad47 None admin] PATH_INFO: `/v3/services` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:29:07.381429 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c079eb41-72a8-459e-ac8a-95d47046ad47 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:29:07.381765 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c079eb41-72a8-459e-ac8a-95d47046ad47 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:29:07.383131 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c079eb41-72a8-459e-ac8a-95d47046ad47 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:29:07.388359 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 389/794] 10.222.0.23 () {56 vars in 1112 bytes} [Thu Aug 18 19:29:07 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:29:07.394219 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6f754d-7c98-4217-8c59-596f693b0de2 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:29:07.445705 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:29:07.498411 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6f754d-7c98-4217-8c59-596f693b0de2 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:29:07.532093 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71c9307-78f7-4293-a93d-759150ba6050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:29:07.532708 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71c9307-78f7-4293-a93d-759150ba6050 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:29:07.532970 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71c9307-78f7-4293-a93d-759150ba6050 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:29:07.533236 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71c9307-78f7-4293-a93d-759150ba6050 None admin] PATH_INFO: `/v3/services` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:29:07.533888 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71c9307-78f7-4293-a93d-759150ba6050 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:29:07.534189 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71c9307-78f7-4293-a93d-759150ba6050 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:29:07.535541 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71c9307-78f7-4293-a93d-759150ba6050 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:29:07.540022 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 406/795] 10.222.0.23 () {56 vars in 1112 bytes} [Thu Aug 18 19:29:07 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:29:08.394866 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35578631-6694-4640-a9c4-57eb4dfd7693 None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:29:08.395399 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35578631-6694-4640-a9c4-57eb4dfd7693 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:29:08.395399 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35578631-6694-4640-a9c4-57eb4dfd7693 None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:29:08.396729 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 390/796] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:29:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:29:08.402532 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32ace71-298e-4632-8727-4e7e70a7ac2b None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:29:08.402942 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32ace71-298e-4632-8727-4e7e70a7ac2b None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:29:08.403072 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32ace71-298e-4632-8727-4e7e70a7ac2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:29:08.421289 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-f32ace71-298e-4632-8727-4e7e70a7ac2b None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:29:08.422489 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-f32ace71-298e-4632-8727-4e7e70a7ac2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:29:08.488719 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 407/797] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:29:08 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 19:29:08.819895 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35578631-6694-4640-a9c4-57eb4dfd7693 None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:29:08.846876 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:29:08.919434 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35578631-6694-4640-a9c4-57eb4dfd7693 None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:29:08.952002 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9cbbe3-a7c8-45e3-9a78-1cda62a7e0f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:29:08.952592 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9cbbe3-a7c8-45e3-9a78-1cda62a7e0f8 None admin] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:29:08.952869 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9cbbe3-a7c8-45e3-9a78-1cda62a7e0f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:29:08.953139 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9cbbe3-a7c8-45e3-9a78-1cda62a7e0f8 None admin] PATH_INFO: `/v3/projects` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:29:08.953804 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9cbbe3-a7c8-45e3-9a78-1cda62a7e0f8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:29:08.955212 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9cbbe3-a7c8-45e3-9a78-1cda62a7e0f8 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:29:08.957767 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: WARNING keystone.server.flask.common [None req-2f9cbbe3-a7c8-45e3-9a78-1cda62a7e0f8 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 18 19:29:09.005041 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.sql.core [None req-2f9cbbe3-a7c8-45e3-9a78-1cda62a7e0f8 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 18 19:29:09.005041 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 18 19:29:09.005041 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [parameters: {'id': 'f9602a5f0caf4489ae12af565a3beffd', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 18 19:29:09.005041 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88471) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 18 19:29:09.021170 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application [None req-2f9cbbe3-a7c8-45e3-9a78-1cda62a7e0f8 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f9602a5f0caf4489ae12af565a3beffd.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f9602a5f0caf4489ae12af565a3beffd. Aug 18 19:29:09.021170 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:29:09.021170 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 18 19:29:09.021170 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 18 19:29:09.021170 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 18 19:29:09.021170 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 18 19:29:09.021170 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 18 19:29:09.021170 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application result = self._query(query) Aug 18 19:29:09.021170 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 18 19:29:09.021170 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application conn.query(q) Aug 18 19:29:09.021170 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 18 19:29:09.021170 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 18 19:29:09.021170 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 18 19:29:09.022028 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application result.read() Aug 18 19:29:09.022028 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 18 19:29:09.022028 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 18 19:29:09.022028 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 18 19:29:09.022028 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 18 19:29:09.022028 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 18 19:29:09.022028 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 18 19:29:09.022028 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 18 19:29:09.022028 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 18 19:29:09.022028 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 18 19:29:09.022028 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:29:09.022028 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 18 19:29:09.022028 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:29:09.022028 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:29:09.022028 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 18 19:29:09.022028 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 18 19:29:09.022028 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 18 19:29:09.022028 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 18 19:29:09.023269 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 18 19:29:09.023269 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application next(self.gen) Aug 18 19:29:09.023269 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 18 19:29:09.023269 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application yield resource Aug 18 19:29:09.023269 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 18 19:29:09.023269 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application next(self.gen) Aug 18 19:29:09.023269 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 18 19:29:09.023269 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application self.session.rollback() Aug 18 19:29:09.023269 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 18 19:29:09.023269 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application self.force_reraise() Aug 18 19:29:09.023269 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 18 19:29:09.023269 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise self.value Aug 18 19:29:09.023269 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 18 19:29:09.023269 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 18 19:29:09.023269 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 18 19:29:09.023269 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application session.commit() Aug 18 19:29:09.023269 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 18 19:29:09.024390 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 18 19:29:09.024390 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 18 19:29:09.024390 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application self._prepare_impl() Aug 18 19:29:09.024390 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 18 19:29:09.024390 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application self.session.flush() Aug 18 19:29:09.024390 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 18 19:29:09.024390 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application self._flush(objects) Aug 18 19:29:09.024390 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 18 19:29:09.024390 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 18 19:29:09.024390 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 18 19:29:09.024390 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application compat.raise_( Aug 18 19:29:09.024390 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 18 19:29:09.024390 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception Aug 18 19:29:09.024390 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 18 19:29:09.024390 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application flush_context.execute() Aug 18 19:29:09.024390 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 18 19:29:09.024390 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application rec.execute(self) Aug 18 19:29:09.025342 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 18 19:29:09.025342 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 18 19:29:09.025342 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 18 19:29:09.025342 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 18 19:29:09.025342 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 18 19:29:09.025342 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 18 19:29:09.025342 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 18 19:29:09.025342 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 18 19:29:09.025342 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 18 19:29:09.025342 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 18 19:29:09.025342 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 18 19:29:09.025342 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 18 19:29:09.025342 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 18 19:29:09.025342 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 18 19:29:09.025342 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 18 19:29:09.026687 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 18 19:29:09.026687 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 18 19:29:09.026687 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception Aug 18 19:29:09.026687 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 18 19:29:09.026687 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 18 19:29:09.026687 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 18 19:29:09.026687 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 18 19:29:09.026687 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 18 19:29:09.026687 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application result = self._query(query) Aug 18 19:29:09.026687 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 18 19:29:09.026687 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application conn.query(q) Aug 18 19:29:09.026687 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 18 19:29:09.026687 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 18 19:29:09.026687 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 18 19:29:09.026687 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application result.read() Aug 18 19:29:09.026687 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 18 19:29:09.026687 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 18 19:29:09.028102 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 18 19:29:09.028102 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 18 19:29:09.028102 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 18 19:29:09.028102 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 18 19:29:09.028102 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 18 19:29:09.028102 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 18 19:29:09.028102 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 18 19:29:09.028102 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 18 19:29:09.028102 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application [parameters: {'id': 'f9602a5f0caf4489ae12af565a3beffd', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 18 19:29:09.028102 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 18 19:29:09.028102 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:29:09.028102 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 19:29:09.028102 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:29:09.028102 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:29:09.028102 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 18 19:29:09.029210 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 18 19:29:09.029210 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 18 19:29:09.029210 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 18 19:29:09.029210 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 18 19:29:09.029210 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:29:09.029210 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 19:29:09.029210 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:29:09.029210 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:29:09.029210 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:29:09.029210 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:29:09.029210 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:29:09.029210 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:29:09.029210 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:29:09.029210 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:29:09.029210 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:29:09.029210 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:29:09.029210 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:29:09.030424 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:29:09.030424 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 18 19:29:09.030424 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 18 19:29:09.030424 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:29:09.030424 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:29:09.030424 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 18 19:29:09.030424 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 18 19:29:09.030424 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f9602a5f0caf4489ae12af565a3beffd. Aug 18 19:29:09.030424 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:29:09.030424 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 391/798] 10.222.0.23 () {60 vars in 1140 bytes} [Thu Aug 18 19:29:08 2022] POST /identity/v3/projects => generated 262 bytes in 203 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:29:09.031087 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32ace71-298e-4632-8727-4e7e70a7ac2b None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:29:09.076163 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:29:09.133154 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32ace71-298e-4632-8727-4e7e70a7ac2b None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:29:09.167826 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3343de53-180d-4b44-8577-bee64619da11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:29:09.168440 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3343de53-180d-4b44-8577-bee64619da11 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:29:09.168715 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3343de53-180d-4b44-8577-bee64619da11 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:29:09.168983 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3343de53-180d-4b44-8577-bee64619da11 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:29:09.176298 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3343de53-180d-4b44-8577-bee64619da11 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:29:09.177773 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3343de53-180d-4b44-8577-bee64619da11 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:29:09.188539 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application [None req-3343de53-180d-4b44-8577-bee64619da11 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 19:29:09.188539 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:29:09.188539 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:29:09.188539 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:29:09.188539 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:29:09.188539 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:29:09.188539 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:29:09.188539 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:29:09.188539 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:29:09.188539 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:29:09.188539 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:29:09.188539 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:29:09.188539 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 19:29:09.188539 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 19:29:09.188539 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 19:29:09.189613 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 19:29:09.189613 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:29:09.189613 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:29:09.189613 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:29:09.189613 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:29:09.189613 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:29:09.189613 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:29:09.189613 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:29:09.189613 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application with Lock( Aug 18 19:29:09.189613 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:29:09.189613 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:29:09.189613 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:29:09.189613 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:29:09.189613 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:29:09.189613 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:29:09.189613 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:29:09.189613 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:29:09.195515 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 19:29:09.195515 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 19:29:09.195515 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 19:29:09.195515 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 19:29:09.195515 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 19:29:09.195515 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 19:29:09.195515 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 19:29:09.195515 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:29:09.195515 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 408/799] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Aug 18 19:29:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:29:09.196213 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9cbbe3-a7c8-45e3-9a78-1cda62a7e0f8 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:29:09.277989 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:29:09.295680 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9cbbe3-a7c8-45e3-9a78-1cda62a7e0f8 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:29:09.330311 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccee29dd-8ce0-4d1b-8a3b-a4d0a9ced67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:29:09.331164 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee29dd-8ce0-4d1b-8a3b-a4d0a9ced67b None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:29:09.332126 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee29dd-8ce0-4d1b-8a3b-a4d0a9ced67b None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:29:09.332126 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee29dd-8ce0-4d1b-8a3b-a4d0a9ced67b None admin] PATH_INFO: `/v3/projects` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:29:09.332907 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccee29dd-8ce0-4d1b-8a3b-a4d0a9ced67b None admin] RBAC: Adding query filter params (name=service) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:29:09.333275 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccee29dd-8ce0-4d1b-8a3b-a4d0a9ced67b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:29:09.335283 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccee29dd-8ce0-4d1b-8a3b-a4d0a9ced67b None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:29:09.369884 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 392/800] 10.222.0.23 () {56 vars in 1112 bytes} [Thu Aug 18 19:29:09 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:29:09.730544 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e6388-d942-4743-b1ce-53865b71c397 None None] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:29:09.731076 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e6388-d942-4743-b1ce-53865b71c397 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:29:09.731076 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e6388-d942-4743-b1ce-53865b71c397 None None] PATH_INFO: `/` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:29:09.732396 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 409/801] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:29:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:29:09.737732 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c4cd1-4727-4e5b-9a95-14751dafbefa None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:29:09.738115 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c4cd1-4727-4e5b-9a95-14751dafbefa None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:29:09.738285 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c4cd1-4727-4e5b-9a95-14751dafbefa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:29:09.757462 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-0d3c4cd1-4727-4e5b-9a95-14751dafbefa None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:29:09.759101 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-0d3c4cd1-4727-4e5b-9a95-14751dafbefa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:29:09.824896 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 393/802] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:29:09 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 19:29:10.155219 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548e6388-d942-4743-b1ce-53865b71c397 None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:29:10.251482 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:29:10.255177 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548e6388-d942-4743-b1ce-53865b71c397 None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:29:10.289302 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25180062-95f3-4286-8887-4de9f1728eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:29:10.289927 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25180062-95f3-4286-8887-4de9f1728eeb None admin] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:29:10.290212 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25180062-95f3-4286-8887-4de9f1728eeb None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:29:10.290486 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25180062-95f3-4286-8887-4de9f1728eeb None admin] PATH_INFO: `/v3/services` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:29:10.291133 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25180062-95f3-4286-8887-4de9f1728eeb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:29:10.292547 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25180062-95f3-4286-8887-4de9f1728eeb None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:29:10.376824 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 410/803] 10.222.0.23 () {60 vars in 1141 bytes} [Thu Aug 18 19:29:10 2022] POST /identity/v3/services => generated 242 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 19:29:11.593289 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4bf3e6-4064-4086-a9a1-097608a68203 None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:29:11.593866 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4bf3e6-4064-4086-a9a1-097608a68203 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:29:11.593866 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4bf3e6-4064-4086-a9a1-097608a68203 None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:29:11.595209 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 394/804] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:29:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:29:11.600236 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ebffee-f03d-4629-b6d1-65d1e26fab7c None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:29:11.600659 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ebffee-f03d-4629-b6d1-65d1e26fab7c None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:29:11.600774 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ebffee-f03d-4629-b6d1-65d1e26fab7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:29:11.618338 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-87ebffee-f03d-4629-b6d1-65d1e26fab7c None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:29:11.619997 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-87ebffee-f03d-4629-b6d1-65d1e26fab7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:29:11.689921 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 411/805] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:29:11 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 19:29:12.011191 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4bf3e6-4064-4086-a9a1-097608a68203 None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:29:12.087225 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:29:12.118531 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4bf3e6-4064-4086-a9a1-097608a68203 None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:29:12.153064 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d143e4d-ea7e-4ee6-bba9-1743372eb31c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:29:12.153941 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d143e4d-ea7e-4ee6-bba9-1743372eb31c None admin] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:29:12.154219 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d143e4d-ea7e-4ee6-bba9-1743372eb31c None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:29:12.154588 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d143e4d-ea7e-4ee6-bba9-1743372eb31c None admin] PATH_INFO: `/v3/users` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:29:12.155221 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d143e4d-ea7e-4ee6-bba9-1743372eb31c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:29:12.156643 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d143e4d-ea7e-4ee6-bba9-1743372eb31c None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:29:12.205351 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.sql.core [None req-1d143e4d-ea7e-4ee6-bba9-1743372eb31c None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 18 19:29:12.205351 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 18 19:29:12.205351 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [parameters: {'user_id': '46cce7be3cc743599953293c7c9fada3', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 18 19:29:12.205351 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88471) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 18 19:29:12.212010 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application [None req-1d143e4d-ea7e-4ee6-bba9-1743372eb31c None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 18 19:29:12.212010 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:29:12.212010 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 18 19:29:12.212010 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 18 19:29:12.212010 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 18 19:29:12.212010 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 18 19:29:12.212010 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 18 19:29:12.212010 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application result = self._query(query) Aug 18 19:29:12.212010 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 18 19:29:12.212010 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application conn.query(q) Aug 18 19:29:12.212010 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 18 19:29:12.212010 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 18 19:29:12.212010 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 18 19:29:12.212010 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application result.read() Aug 18 19:29:12.212010 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 18 19:29:12.213444 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 18 19:29:12.213444 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 18 19:29:12.213444 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 18 19:29:12.213444 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 18 19:29:12.213444 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 18 19:29:12.213444 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 18 19:29:12.213444 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 18 19:29:12.213444 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 18 19:29:12.213444 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:29:12.213444 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 18 19:29:12.213444 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:29:12.213444 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:29:12.213444 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 18 19:29:12.213444 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 18 19:29:12.213444 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 18 19:29:12.213444 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 18 19:29:12.213444 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 18 19:29:12.213444 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application next(self.gen) Aug 18 19:29:12.214602 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 18 19:29:12.214602 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application yield resource Aug 18 19:29:12.214602 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 18 19:29:12.214602 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application next(self.gen) Aug 18 19:29:12.214602 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 18 19:29:12.214602 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application self.session.rollback() Aug 18 19:29:12.214602 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 18 19:29:12.214602 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application self.force_reraise() Aug 18 19:29:12.214602 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 18 19:29:12.214602 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise self.value Aug 18 19:29:12.214602 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 18 19:29:12.214602 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 18 19:29:12.214602 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 18 19:29:12.214602 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application session.commit() Aug 18 19:29:12.214602 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 18 19:29:12.214602 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 18 19:29:12.214602 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 18 19:29:12.215682 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application self._prepare_impl() Aug 18 19:29:12.215682 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 18 19:29:12.215682 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application self.session.flush() Aug 18 19:29:12.215682 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 18 19:29:12.215682 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application self._flush(objects) Aug 18 19:29:12.215682 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 18 19:29:12.215682 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 18 19:29:12.215682 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 18 19:29:12.215682 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application compat.raise_( Aug 18 19:29:12.215682 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 18 19:29:12.215682 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception Aug 18 19:29:12.215682 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 18 19:29:12.215682 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application flush_context.execute() Aug 18 19:29:12.215682 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 18 19:29:12.215682 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application rec.execute(self) Aug 18 19:29:12.215682 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 18 19:29:12.215682 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 18 19:29:12.216547 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 18 19:29:12.216547 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 18 19:29:12.216547 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 18 19:29:12.216547 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 18 19:29:12.216547 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 18 19:29:12.216547 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 18 19:29:12.216547 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 18 19:29:12.216547 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 18 19:29:12.216547 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 18 19:29:12.216547 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 18 19:29:12.216547 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 18 19:29:12.216547 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 18 19:29:12.216547 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 18 19:29:12.216547 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 18 19:29:12.216547 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 18 19:29:12.216547 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception Aug 18 19:29:12.217396 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 18 19:29:12.217396 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 18 19:29:12.217396 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 18 19:29:12.217396 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 18 19:29:12.217396 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 18 19:29:12.217396 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application result = self._query(query) Aug 18 19:29:12.217396 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 18 19:29:12.217396 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application conn.query(q) Aug 18 19:29:12.217396 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 18 19:29:12.217396 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 18 19:29:12.217396 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 18 19:29:12.217396 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application result.read() Aug 18 19:29:12.217396 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 18 19:29:12.217396 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 18 19:29:12.217396 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 18 19:29:12.217396 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 18 19:29:12.218278 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 18 19:29:12.218278 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 18 19:29:12.218278 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 18 19:29:12.218278 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 18 19:29:12.218278 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 18 19:29:12.218278 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 18 19:29:12.218278 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application [parameters: {'user_id': '46cce7be3cc743599953293c7c9fada3', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 18 19:29:12.218278 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 18 19:29:12.218278 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:29:12.218278 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 19:29:12.218278 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:29:12.218278 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:29:12.218278 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:29:12.218278 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:29:12.218278 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:29:12.220070 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:29:12.220070 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:29:12.220070 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:29:12.220070 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:29:12.220070 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:29:12.220070 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:29:12.220070 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:29:12.220070 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 18 19:29:12.220070 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 18 19:29:12.220070 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:29:12.220070 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:29:12.220070 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 19:29:12.220070 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 19:29:12.220070 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 19:29:12.220070 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 19:29:12.220070 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 18 19:29:12.220070 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 18 19:29:12.221256 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 18 19:29:12.221256 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 18 19:29:12.221256 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 18 19:29:12.221256 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 18 19:29:12.221256 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 18 19:29:12.221256 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:29:12.221256 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 395/806] 10.222.0.23 () {60 vars in 1131 bytes} [Thu Aug 18 19:29:12 2022] POST /identity/v3/users => generated 160 bytes in 203 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:29:12.221850 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ebffee-f03d-4629-b6d1-65d1e26fab7c None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:29:12.302279 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:29:12.316333 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ebffee-f03d-4629-b6d1-65d1e26fab7c None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:29:12.350346 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bac0a7-8e9a-46a7-bd4e-cdfa6371a446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:29:12.350968 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bac0a7-8e9a-46a7-bd4e-cdfa6371a446 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:29:12.351247 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bac0a7-8e9a-46a7-bd4e-cdfa6371a446 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:29:12.351589 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bac0a7-8e9a-46a7-bd4e-cdfa6371a446 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:29:12.359131 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bac0a7-8e9a-46a7-bd4e-cdfa6371a446 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:29:12.360562 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bac0a7-8e9a-46a7-bd4e-cdfa6371a446 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:29:12.372010 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application [None req-42bac0a7-8e9a-46a7-bd4e-cdfa6371a446 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 18 19:29:12.372010 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:29:12.372010 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:29:12.372010 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:29:12.372010 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:29:12.372010 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:29:12.372010 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:29:12.372010 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:29:12.372010 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:29:12.372010 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:29:12.372010 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:29:12.372010 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:29:12.372010 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 19:29:12.372010 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 19:29:12.372010 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 19:29:12.372010 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 19:29:12.372985 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:29:12.372985 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:29:12.372985 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 19:29:12.372985 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 19:29:12.372985 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 19:29:12.372985 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 19:29:12.372985 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:29:12.372985 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:29:12.372985 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:29:12.372985 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:29:12.372985 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:29:12.372985 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application with Lock( Aug 18 19:29:12.372985 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:29:12.372985 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:29:12.372985 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:29:12.372985 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:29:12.372985 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:29:12.372985 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:29:12.374000 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:29:12.374000 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:29:12.374000 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 19:29:12.374000 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 19:29:12.374000 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 19:29:12.374000 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 19:29:12.374000 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 19:29:12.374000 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 19:29:12.374000 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 18 19:29:12.374000 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:29:12.378070 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 412/807] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Aug 18 19:29:12 2022] GET /identity/v3/users/cinder => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:29:12.379274 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d143e4d-ea7e-4ee6-bba9-1743372eb31c None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:29:12.482403 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d143e4d-ea7e-4ee6-bba9-1743372eb31c None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:29:12.515528 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb363dde-e035-42d3-8d2f-1ce68ca47605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:29:12.516133 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb363dde-e035-42d3-8d2f-1ce68ca47605 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:29:12.516412 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb363dde-e035-42d3-8d2f-1ce68ca47605 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:29:12.516681 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb363dde-e035-42d3-8d2f-1ce68ca47605 None admin] PATH_INFO: `/v3/users` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:29:12.517371 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb363dde-e035-42d3-8d2f-1ce68ca47605 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:29:12.517761 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb363dde-e035-42d3-8d2f-1ce68ca47605 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:29:12.519367 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb363dde-e035-42d3-8d2f-1ce68ca47605 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:29:12.521015 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:29:12.552559 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1955a478-fa10-47d4-960f-aa3046d9f3d5 None None] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:29:12.552742 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1955a478-fa10-47d4-960f-aa3046d9f3d5 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:29:12.552947 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1955a478-fa10-47d4-960f-aa3046d9f3d5 None None] PATH_INFO: `/` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:29:12.554301 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 413/808] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:29:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 19:29:12.557610 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 396/809] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Aug 18 19:29:12 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:29:12.559224 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff6f1e4-490a-40d6-a68d-0d943ebd9249 None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:29:12.559505 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff6f1e4-490a-40d6-a68d-0d943ebd9249 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:29:12.559778 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff6f1e4-490a-40d6-a68d-0d943ebd9249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:29:12.580128 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-2ff6f1e4-490a-40d6-a68d-0d943ebd9249 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:29:12.581625 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-2ff6f1e4-490a-40d6-a68d-0d943ebd9249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:29:12.653929 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 414/810] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:29:12 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 19:29:12.976672 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb363dde-e035-42d3-8d2f-1ce68ca47605 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:29:13.077250 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb363dde-e035-42d3-8d2f-1ce68ca47605 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:29:13.111035 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccf7220-447c-497b-b553-a07498776738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:29:13.111658 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccf7220-447c-497b-b553-a07498776738 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:29:13.111937 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccf7220-447c-497b-b553-a07498776738 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:29:13.112262 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccf7220-447c-497b-b553-a07498776738 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:29:13.112989 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccf7220-447c-497b-b553-a07498776738 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:29:13.114401 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccf7220-447c-497b-b553-a07498776738 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:29:13.123519 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application [None req-0ccf7220-447c-497b-b553-a07498776738 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 19:29:13.123519 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:29:13.123519 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 19:29:13.123519 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 19:29:13.123519 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 19:29:13.123519 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 19:29:13.123519 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 19:29:13.123519 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 19:29:13.123519 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 19:29:13.123519 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:29:13.123519 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 19:29:13.123519 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:29:13.123519 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:29:13.123519 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:29:13.123519 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:29:13.123519 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:29:13.123519 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:29:13.124638 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:29:13.124638 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:29:13.124638 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:29:13.124638 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:29:13.124638 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:29:13.124638 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:29:13.124638 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 19:29:13.124638 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 19:29:13.124638 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 19:29:13.124638 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 19:29:13.124638 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:29:13.124638 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:29:13.124638 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:29:13.124638 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:29:13.124638 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:29:13.124638 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:29:13.125486 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:29:13.125486 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application with Lock( Aug 18 19:29:13.125486 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:29:13.125486 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:29:13.125486 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:29:13.125486 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:29:13.125486 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:29:13.125486 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:29:13.125486 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:29:13.125486 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:29:13.125486 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 19:29:13.125486 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 19:29:13.125486 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 19:29:13.125486 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:29:13.125486 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 397/811] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Aug 18 19:29:12 2022] GET /identity/v3/services/compute => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:29:13.130585 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff6f1e4-490a-40d6-a68d-0d943ebd9249 None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:29:13.207371 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:29:13.229958 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff6f1e4-490a-40d6-a68d-0d943ebd9249 None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:29:13.263588 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51237cb5-9fcc-4146-a2b8-19c2c71935ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:29:13.264180 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51237cb5-9fcc-4146-a2b8-19c2c71935ed None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:29:13.264461 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51237cb5-9fcc-4146-a2b8-19c2c71935ed None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:29:13.264735 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51237cb5-9fcc-4146-a2b8-19c2c71935ed None admin] PATH_INFO: `/v3/services` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:29:13.265353 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51237cb5-9fcc-4146-a2b8-19c2c71935ed None admin] RBAC: Adding query filter params (name=compute) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:29:13.265683 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51237cb5-9fcc-4146-a2b8-19c2c71935ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:29:13.267093 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51237cb5-9fcc-4146-a2b8-19c2c71935ed None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:29:13.271749 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 415/812] 10.222.0.23 () {56 vars in 1112 bytes} [Thu Aug 18 19:29:13 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:29:13.277352 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccf7220-447c-497b-b553-a07498776738 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:29:13.331596 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:29:13.374636 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccf7220-447c-497b-b553-a07498776738 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:29:13.407156 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179d082e-f012-4a2a-8c80-16c0a2c4ae3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:29:13.407757 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179d082e-f012-4a2a-8c80-16c0a2c4ae3a None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:29:13.408035 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179d082e-f012-4a2a-8c80-16c0a2c4ae3a None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:29:13.408303 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179d082e-f012-4a2a-8c80-16c0a2c4ae3a None admin] PATH_INFO: `/v3/services` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:29:13.408918 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179d082e-f012-4a2a-8c80-16c0a2c4ae3a None admin] RBAC: Adding query filter params (type=compute) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:29:13.409216 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179d082e-f012-4a2a-8c80-16c0a2c4ae3a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:29:13.410593 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179d082e-f012-4a2a-8c80-16c0a2c4ae3a None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:29:13.415287 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 398/813] 10.222.0.23 () {56 vars in 1112 bytes} [Thu Aug 18 19:29:13 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:29:13.421802 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51237cb5-9fcc-4146-a2b8-19c2c71935ed None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:29:13.518376 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51237cb5-9fcc-4146-a2b8-19c2c71935ed None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:29:13.551127 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cd0b0f-cb19-4a48-b3fc-f4be5b84bea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:29:13.551712 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd0b0f-cb19-4a48-b3fc-f4be5b84bea4 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:29:13.551988 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd0b0f-cb19-4a48-b3fc-f4be5b84bea4 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:29:13.552257 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd0b0f-cb19-4a48-b3fc-f4be5b84bea4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:29:13.552931 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cd0b0f-cb19-4a48-b3fc-f4be5b84bea4 None admin] RBAC: Adding query filter params (interface=public, service_id=f78e3a75e60c4264a713d1e974cc4a83, region_id=RegionOne) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:29:13.553238 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cd0b0f-cb19-4a48-b3fc-f4be5b84bea4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:29:13.554603 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cd0b0f-cb19-4a48-b3fc-f4be5b84bea4 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:29:13.559354 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 416/814] 10.222.0.23 () {56 vars in 1251 bytes} [Thu Aug 18 19:29:13 2022] GET /identity/v3/endpoints?service_id=f78e3a75e60c4264a713d1e974cc4a83&interface=public®ion_id=RegionOne => generated 194 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:29:13.565096 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179d082e-f012-4a2a-8c80-16c0a2c4ae3a None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:29:13.662912 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179d082e-f012-4a2a-8c80-16c0a2c4ae3a None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:29:13.682370 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:29:13.695637 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be18b03-0095-4795-88c2-acbc7d8dc5a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:29:13.696233 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be18b03-0095-4795-88c2-acbc7d8dc5a2 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:29:13.696517 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be18b03-0095-4795-88c2-acbc7d8dc5a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:29:13.704704 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be18b03-0095-4795-88c2-acbc7d8dc5a2 None admin] PATH_INFO: `/v3/services` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:29:13.704704 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be18b03-0095-4795-88c2-acbc7d8dc5a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:29:13.704704 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be18b03-0095-4795-88c2-acbc7d8dc5a2 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:29:13.704939 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 399/815] 10.222.0.23 () {56 vars in 1087 bytes} [Thu Aug 18 19:29:13 2022] GET /identity/v3/services => generated 1728 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 19:29:15.842774 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253668bf-4f27-497f-af32-098b545b2326 None None] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:29:15.843303 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253668bf-4f27-497f-af32-098b545b2326 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:29:15.843303 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253668bf-4f27-497f-af32-098b545b2326 None None] PATH_INFO: `/` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:29:15.844645 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 417/816] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:29:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:29:15.849789 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fe29aa-1bee-405a-9269-4a9947a33710 None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:29:15.850176 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fe29aa-1bee-405a-9269-4a9947a33710 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:29:15.850335 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fe29aa-1bee-405a-9269-4a9947a33710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:29:15.868579 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-09fe29aa-1bee-405a-9269-4a9947a33710 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:29:15.870146 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-09fe29aa-1bee-405a-9269-4a9947a33710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:29:15.934278 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 400/817] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:29:15 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 19:29:16.258915 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253668bf-4f27-497f-af32-098b545b2326 None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:29:16.263358 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:29:16.358882 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253668bf-4f27-497f-af32-098b545b2326 None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:29:16.392287 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32003d7-7893-4142-a08b-e225a14f69b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:29:16.392903 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32003d7-7893-4142-a08b-e225a14f69b2 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:29:16.393183 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32003d7-7893-4142-a08b-e225a14f69b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:29:16.393458 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32003d7-7893-4142-a08b-e225a14f69b2 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:29:16.394069 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32003d7-7893-4142-a08b-e225a14f69b2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:29:16.395432 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32003d7-7893-4142-a08b-e225a14f69b2 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:29:16.404471 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application [None req-e32003d7-7893-4142-a08b-e225a14f69b2 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 19:29:16.404471 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:29:16.404471 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 19:29:16.404471 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 19:29:16.404471 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 19:29:16.404471 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 19:29:16.404471 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 19:29:16.404471 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 19:29:16.404471 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 19:29:16.404471 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:29:16.404471 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 19:29:16.404471 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:29:16.404471 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:29:16.404471 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:29:16.404471 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:29:16.404471 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:29:16.404471 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:29:16.405591 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:29:16.405591 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:29:16.405591 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:29:16.405591 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:29:16.405591 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:29:16.405591 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:29:16.405591 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 19:29:16.405591 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 19:29:16.405591 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 19:29:16.405591 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 19:29:16.405591 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:29:16.405591 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:29:16.405591 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:29:16.405591 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:29:16.405591 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:29:16.405591 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:29:16.406473 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:29:16.406473 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application with Lock( Aug 18 19:29:16.406473 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:29:16.406473 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:29:16.406473 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:29:16.406473 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:29:16.406473 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:29:16.406473 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:29:16.406473 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:29:16.406473 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:29:16.406473 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 19:29:16.406473 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 19:29:16.406473 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 19:29:16.406473 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:29:16.406473 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 418/818] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Aug 18 19:29:16 2022] GET /identity/v3/services/compute => generated 88 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:29:16.411405 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fe29aa-1bee-405a-9269-4a9947a33710 None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:29:16.508822 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fe29aa-1bee-405a-9269-4a9947a33710 None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:29:16.522830 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:29:16.542234 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c13de-25bf-4cdc-8f9d-6e1f5e654da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:29:16.542835 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c13de-25bf-4cdc-8f9d-6e1f5e654da5 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:29:16.543131 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c13de-25bf-4cdc-8f9d-6e1f5e654da5 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:29:16.543391 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c13de-25bf-4cdc-8f9d-6e1f5e654da5 None admin] PATH_INFO: `/v3/services` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:29:16.544039 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3c13de-25bf-4cdc-8f9d-6e1f5e654da5 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:29:16.544339 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3c13de-25bf-4cdc-8f9d-6e1f5e654da5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:29:16.545720 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3c13de-25bf-4cdc-8f9d-6e1f5e654da5 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:29:16.550650 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 401/819] 10.222.0.23 () {56 vars in 1112 bytes} [Thu Aug 18 19:29:16 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:29:16.556781 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32003d7-7893-4142-a08b-e225a14f69b2 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:29:16.622832 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:29:16.655304 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32003d7-7893-4142-a08b-e225a14f69b2 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:29:16.687915 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd8b025-a60f-4d67-a70a-4fcfb75273d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:29:16.688507 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd8b025-a60f-4d67-a70a-4fcfb75273d0 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:29:16.688834 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd8b025-a60f-4d67-a70a-4fcfb75273d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:29:16.689106 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd8b025-a60f-4d67-a70a-4fcfb75273d0 None admin] PATH_INFO: `/v3/services` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:29:16.689757 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd8b025-a60f-4d67-a70a-4fcfb75273d0 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:29:16.690060 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd8b025-a60f-4d67-a70a-4fcfb75273d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:29:16.691412 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd8b025-a60f-4d67-a70a-4fcfb75273d0 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:29:16.696007 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 419/820] 10.222.0.23 () {56 vars in 1112 bytes} [Thu Aug 18 19:29:16 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:29:16.702502 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c13de-25bf-4cdc-8f9d-6e1f5e654da5 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:29:16.801703 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c13de-25bf-4cdc-8f9d-6e1f5e654da5 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:29:16.838698 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601d8ca8-cfc3-44fe-8dfc-6cd89f40b996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:29:16.839304 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d8ca8-cfc3-44fe-8dfc-6cd89f40b996 None admin] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:29:16.839584 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d8ca8-cfc3-44fe-8dfc-6cd89f40b996 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:29:16.839857 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d8ca8-cfc3-44fe-8dfc-6cd89f40b996 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:29:16.840527 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601d8ca8-cfc3-44fe-8dfc-6cd89f40b996 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:29:16.841945 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601d8ca8-cfc3-44fe-8dfc-6cd89f40b996 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:29:16.912434 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 402/821] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Aug 18 19:29:16 2022] POST /identity/v3/endpoints => generated 334 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 19:29:26.693731 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=34 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:29:26.908302 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=82,keystone:INSERT=1 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:30:35.515093 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d580502-c3aa-4cbb-9d3e-8a400e0ec4e6 None None] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:30:35.515668 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d580502-c3aa-4cbb-9d3e-8a400e0ec4e6 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:30:35.515668 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d580502-c3aa-4cbb-9d3e-8a400e0ec4e6 None None] PATH_INFO: `/` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:30:35.516958 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 420/822] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:30:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:30:35.522846 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3641a51-9e6f-4e3e-958b-a0eea5a7c2a6 None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:30:35.523357 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3641a51-9e6f-4e3e-958b-a0eea5a7c2a6 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:30:35.523460 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3641a51-9e6f-4e3e-958b-a0eea5a7c2a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:30:35.542327 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-a3641a51-9e6f-4e3e-958b-a0eea5a7c2a6 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:30:35.543998 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-a3641a51-9e6f-4e3e-958b-a0eea5a7c2a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:30:35.618480 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 403/823] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:30:35 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 19:30:35.941175 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d580502-c3aa-4cbb-9d3e-8a400e0ec4e6 None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:30:36.045072 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d580502-c3aa-4cbb-9d3e-8a400e0ec4e6 None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:30:36.079699 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879382c9-2fdc-4b77-b413-cc24c43c54bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:30:36.080341 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879382c9-2fdc-4b77-b413-cc24c43c54bf None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:30:36.080882 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879382c9-2fdc-4b77-b413-cc24c43c54bf None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:30:36.081155 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879382c9-2fdc-4b77-b413-cc24c43c54bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:30:36.092470 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879382c9-2fdc-4b77-b413-cc24c43c54bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:30:36.094501 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879382c9-2fdc-4b77-b413-cc24c43c54bf None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:30:36.110531 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application [None req-879382c9-2fdc-4b77-b413-cc24c43c54bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:30:36.110531 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:30:36.110531 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:30:36.110531 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:30:36.110531 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:30:36.110531 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:30:36.110531 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:30:36.110531 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:30:36.110531 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:30:36.110531 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:30:36.110531 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:30:36.110531 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:30:36.110531 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 19:30:36.110531 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 19:30:36.110531 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 19:30:36.110531 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 19:30:36.111631 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:30:36.111631 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:30:36.111631 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:30:36.111631 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:30:36.111631 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:30:36.111631 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:30:36.111631 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:30:36.111631 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application with Lock( Aug 18 19:30:36.111631 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:30:36.111631 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:30:36.111631 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:30:36.111631 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:30:36.111631 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:30:36.111631 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:30:36.111631 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:30:36.111631 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:30:36.111631 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 19:30:36.112599 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 19:30:36.112599 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:30:36.112599 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:30:36.112599 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 421/824] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Aug 18 19:30:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:30:36.117899 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3641a51-9e6f-4e3e-958b-a0eea5a7c2a6 None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:30:36.221377 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3641a51-9e6f-4e3e-958b-a0eea5a7c2a6 None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:30:36.247123 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:30:36.255808 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb63f06-06d8-4613-9781-19a9a77f01a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:30:36.256413 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb63f06-06d8-4613-9781-19a9a77f01a9 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:30:36.256686 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb63f06-06d8-4613-9781-19a9a77f01a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:30:36.256954 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb63f06-06d8-4613-9781-19a9a77f01a9 None admin] PATH_INFO: `/v3/domains` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:30:36.257629 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb63f06-06d8-4613-9781-19a9a77f01a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:30:36.265375 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb63f06-06d8-4613-9781-19a9a77f01a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:30:36.265375 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb63f06-06d8-4613-9781-19a9a77f01a9 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:30:36.271583 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 404/825] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Aug 18 19:30:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:30:36.277984 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879382c9-2fdc-4b77-b413-cc24c43c54bf None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:30:36.334718 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:30:36.383410 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879382c9-2fdc-4b77-b413-cc24c43c54bf None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:30:36.419751 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a969896f-ef41-481c-bc6c-0ac25d4d492c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:30:36.420365 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a969896f-ef41-481c-bc6c-0ac25d4d492c None admin] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:30:36.420718 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a969896f-ef41-481c-bc6c-0ac25d4d492c None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:30:36.421230 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a969896f-ef41-481c-bc6c-0ac25d4d492c None admin] PATH_INFO: `/v3/users` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:30:36.422065 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a969896f-ef41-481c-bc6c-0ac25d4d492c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:30:36.423510 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a969896f-ef41-481c-bc6c-0ac25d4d492c None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:30:36.517830 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 422/826] 10.222.0.23 () {60 vars in 1132 bytes} [Thu Aug 18 19:30:36 2022] POST /identity/v3/users => generated 251 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 19:30:38.764050 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc88735-62b4-470b-9a9f-5fda1fb47ab8 None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:30:38.764585 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc88735-62b4-470b-9a9f-5fda1fb47ab8 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:30:38.764697 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc88735-62b4-470b-9a9f-5fda1fb47ab8 None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:30:38.766063 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 405/827] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:30:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:30:38.771343 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94fe05a-c524-44d8-89f8-eeb363be96b0 None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:30:38.771740 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94fe05a-c524-44d8-89f8-eeb363be96b0 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:30:38.771895 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94fe05a-c524-44d8-89f8-eeb363be96b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:30:38.790258 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-f94fe05a-c524-44d8-89f8-eeb363be96b0 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:30:38.791453 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-f94fe05a-c524-44d8-89f8-eeb363be96b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:30:38.861530 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 423/828] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:30:38 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 19:30:39.186761 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc88735-62b4-470b-9a9f-5fda1fb47ab8 None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:30:39.297398 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc88735-62b4-470b-9a9f-5fda1fb47ab8 None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:30:39.332498 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf7a7af-c1c7-47f5-9ead-6768302167d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:30:39.333065 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf7a7af-c1c7-47f5-9ead-6768302167d4 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:30:39.333342 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf7a7af-c1c7-47f5-9ead-6768302167d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:30:39.333611 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf7a7af-c1c7-47f5-9ead-6768302167d4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:30:39.344884 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf7a7af-c1c7-47f5-9ead-6768302167d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:30:39.349528 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application [None req-bbf7a7af-c1c7-47f5-9ead-6768302167d4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 19:30:39.349528 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:30:39.349528 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:30:39.349528 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:30:39.349528 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:30:39.349528 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:30:39.349528 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:30:39.349528 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:30:39.349528 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:30:39.349528 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:30:39.349528 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:30:39.349528 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:30:39.349528 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:30:39.349528 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:30:39.349528 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:30:39.349528 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:30:39.350544 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:30:39.350544 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:30:39.350544 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:30:39.350544 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:30:39.350544 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:30:39.350544 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:30:39.350544 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:30:39.350544 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:30:39.350544 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:30:39.350544 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:30:39.350544 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:30:39.350544 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application with Lock( Aug 18 19:30:39.350544 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:30:39.350544 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:30:39.350544 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:30:39.350544 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:30:39.351403 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:30:39.351403 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:30:39.351403 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:30:39.351403 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:30:39.351403 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:30:39.351403 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:30:39.351403 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:30:39.351403 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:30:39.351403 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:30:39.351403 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:30:39.351403 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 19:30:39.351403 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:30:39.351403 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 406/829] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Aug 18 19:30:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:30:39.357285 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94fe05a-c524-44d8-89f8-eeb363be96b0 None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:30:39.400647 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:30:39.460947 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94fe05a-c524-44d8-89f8-eeb363be96b0 None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:30:39.496176 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f97b911-ee5a-4663-bd5e-70e5fe49c58b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:30:39.496783 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f97b911-ee5a-4663-bd5e-70e5fe49c58b None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:30:39.497067 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f97b911-ee5a-4663-bd5e-70e5fe49c58b None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:30:39.497335 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f97b911-ee5a-4663-bd5e-70e5fe49c58b None admin] PATH_INFO: `/v3/roles` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:30:39.498023 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f97b911-ee5a-4663-bd5e-70e5fe49c58b None admin] RBAC: Adding query filter params (name=service) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:30:39.498325 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f97b911-ee5a-4663-bd5e-70e5fe49c58b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:30:39.499778 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f97b911-ee5a-4663-bd5e-70e5fe49c58b None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:30:39.507480 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 424/830] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Aug 18 19:30:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:30:39.513521 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf7a7af-c1c7-47f5-9ead-6768302167d4 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:30:39.564957 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:30:39.625457 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf7a7af-c1c7-47f5-9ead-6768302167d4 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:30:39.662356 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2656a54a-ab10-484e-80bb-2fa11165cddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:30:39.662982 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2656a54a-ab10-484e-80bb-2fa11165cddf None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:30:39.663267 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2656a54a-ab10-484e-80bb-2fa11165cddf None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:30:39.663539 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2656a54a-ab10-484e-80bb-2fa11165cddf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:30:39.674551 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2656a54a-ab10-484e-80bb-2fa11165cddf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:30:39.675979 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2656a54a-ab10-484e-80bb-2fa11165cddf None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:30:39.690087 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application [None req-2656a54a-ab10-484e-80bb-2fa11165cddf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:30:39.690087 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:30:39.690087 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:30:39.690087 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:30:39.690087 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:30:39.690087 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:30:39.690087 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:30:39.690087 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:30:39.690087 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:30:39.690087 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:30:39.690087 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:30:39.690087 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:30:39.690087 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 19:30:39.690087 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 19:30:39.690087 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 19:30:39.690087 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 19:30:39.701133 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:30:39.701133 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:30:39.701133 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:30:39.701133 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:30:39.701133 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:30:39.701133 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:30:39.701133 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:30:39.701133 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application with Lock( Aug 18 19:30:39.701133 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:30:39.701133 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:30:39.701133 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:30:39.701133 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:30:39.701133 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:30:39.701133 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:30:39.701133 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:30:39.701133 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:30:39.701133 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 19:30:39.702203 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 19:30:39.702203 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:30:39.702203 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:30:39.702203 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 407/831] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Aug 18 19:30:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:30:39.702444 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f97b911-ee5a-4663-bd5e-70e5fe49c58b None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:30:39.802200 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:30:39.805158 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f97b911-ee5a-4663-bd5e-70e5fe49c58b None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:30:39.840091 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7885b158-ee23-476e-8aac-432d6c923abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:30:39.840828 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885b158-ee23-476e-8aac-432d6c923abd None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:30:39.841368 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885b158-ee23-476e-8aac-432d6c923abd None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:30:39.841834 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885b158-ee23-476e-8aac-432d6c923abd None admin] PATH_INFO: `/v3/domains` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:30:39.842456 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7885b158-ee23-476e-8aac-432d6c923abd None admin] RBAC: Adding query filter params (name=Default) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:30:39.842796 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7885b158-ee23-476e-8aac-432d6c923abd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:30:39.844227 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7885b158-ee23-476e-8aac-432d6c923abd None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:30:39.857276 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 425/832] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Aug 18 19:30:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:30:39.865262 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2656a54a-ab10-484e-80bb-2fa11165cddf None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:30:39.969830 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:30:39.973277 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2656a54a-ab10-484e-80bb-2fa11165cddf None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:30:40.010126 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb77f5a0-4361-494f-a747-f036d19013f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:30:40.010763 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb77f5a0-4361-494f-a747-f036d19013f2 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:30:40.011077 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb77f5a0-4361-494f-a747-f036d19013f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:30:40.011356 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb77f5a0-4361-494f-a747-f036d19013f2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:30:40.020249 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb77f5a0-4361-494f-a747-f036d19013f2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:30:40.021881 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb77f5a0-4361-494f-a747-f036d19013f2 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:30:40.033224 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application [None req-bb77f5a0-4361-494f-a747-f036d19013f2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 18 19:30:40.033224 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:30:40.033224 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:30:40.033224 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:30:40.033224 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:30:40.033224 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:30:40.033224 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:30:40.033224 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:30:40.033224 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:30:40.033224 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:30:40.033224 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:30:40.033224 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:30:40.033224 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 19:30:40.033224 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 19:30:40.033224 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 19:30:40.033224 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 19:30:40.034379 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:30:40.034379 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:30:40.034379 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 19:30:40.034379 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 19:30:40.034379 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 19:30:40.034379 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 19:30:40.034379 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:30:40.034379 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:30:40.034379 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:30:40.034379 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:30:40.034379 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:30:40.034379 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application with Lock( Aug 18 19:30:40.034379 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:30:40.034379 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:30:40.034379 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:30:40.034379 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:30:40.034379 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:30:40.034379 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:30:40.035552 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:30:40.035552 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:30:40.035552 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 19:30:40.035552 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 19:30:40.035552 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 19:30:40.035552 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 19:30:40.035552 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 19:30:40.035552 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 19:30:40.035552 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 18 19:30:40.035552 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:30:40.040586 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 408/833] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Aug 18 19:30:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 19:30:40.040711 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7885b158-ee23-476e-8aac-432d6c923abd None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:30:40.150891 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7885b158-ee23-476e-8aac-432d6c923abd None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:30:40.186602 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886de8b3-b422-4701-83c4-032fed22b4cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:30:40.187296 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886de8b3-b422-4701-83c4-032fed22b4cb None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:30:40.187644 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886de8b3-b422-4701-83c4-032fed22b4cb None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:30:40.187985 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886de8b3-b422-4701-83c4-032fed22b4cb None admin] PATH_INFO: `/v3/users` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:30:40.188766 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886de8b3-b422-4701-83c4-032fed22b4cb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:30:40.189164 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886de8b3-b422-4701-83c4-032fed22b4cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:30:40.190672 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886de8b3-b422-4701-83c4-032fed22b4cb None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:30:40.208531 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 426/834] 10.222.0.23 () {56 vars in 1143 bytes} [Thu Aug 18 19:30:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:30:40.214646 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb77f5a0-4361-494f-a747-f036d19013f2 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:30:40.326779 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb77f5a0-4361-494f-a747-f036d19013f2 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:30:40.381603 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d53aa69-b4a6-4404-9a4c-5cf4b6ee1f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:30:40.381603 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d53aa69-b4a6-4404-9a4c-5cf4b6ee1f82 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:30:40.381603 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d53aa69-b4a6-4404-9a4c-5cf4b6ee1f82 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:30:40.381603 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d53aa69-b4a6-4404-9a4c-5cf4b6ee1f82 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:30:40.395038 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:30:40.437039 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d53aa69-b4a6-4404-9a4c-5cf4b6ee1f82 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:30:40.438552 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d53aa69-b4a6-4404-9a4c-5cf4b6ee1f82 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:30:40.537189 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 409/835] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Aug 18 19:30:40 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 19:30:40.543642 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886de8b3-b422-4701-83c4-032fed22b4cb None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:30:40.562967 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:30:40.646742 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886de8b3-b422-4701-83c4-032fed22b4cb None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:30:40.682437 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0640a316-3b58-4a5c-8c90-6108d1435bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:30:40.683091 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0640a316-3b58-4a5c-8c90-6108d1435bfe None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:30:40.683373 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0640a316-3b58-4a5c-8c90-6108d1435bfe None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:30:40.683758 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0640a316-3b58-4a5c-8c90-6108d1435bfe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:30:40.693875 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0640a316-3b58-4a5c-8c90-6108d1435bfe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:30:40.695310 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0640a316-3b58-4a5c-8c90-6108d1435bfe None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:30:40.710463 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application [None req-0640a316-3b58-4a5c-8c90-6108d1435bfe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:30:40.710463 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:30:40.710463 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:30:40.710463 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:30:40.710463 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:30:40.710463 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:30:40.710463 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:30:40.710463 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:30:40.710463 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:30:40.710463 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:30:40.710463 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:30:40.710463 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:30:40.710463 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 19:30:40.710463 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 19:30:40.710463 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 19:30:40.710463 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 19:30:40.711392 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:30:40.711392 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:30:40.711392 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:30:40.711392 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:30:40.711392 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:30:40.711392 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:30:40.711392 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:30:40.711392 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application with Lock( Aug 18 19:30:40.711392 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:30:40.711392 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:30:40.711392 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:30:40.711392 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:30:40.711392 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:30:40.711392 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:30:40.711392 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:30:40.711392 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:30:40.711392 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 19:30:40.712302 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 19:30:40.712302 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:30:40.712302 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:30:40.712302 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 427/836] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Aug 18 19:30:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:30:40.717990 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d53aa69-b4a6-4404-9a4c-5cf4b6ee1f82 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:30:40.783707 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:30:40.822581 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d53aa69-b4a6-4404-9a4c-5cf4b6ee1f82 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:30:40.862633 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5144e5-143d-4370-b380-31e2c842c658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:30:40.863792 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5144e5-143d-4370-b380-31e2c842c658 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:30:40.864084 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5144e5-143d-4370-b380-31e2c842c658 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:30:40.864359 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5144e5-143d-4370-b380-31e2c842c658 None admin] PATH_INFO: `/v3/domains` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:30:40.864994 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5144e5-143d-4370-b380-31e2c842c658 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:30:40.865306 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5144e5-143d-4370-b380-31e2c842c658 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:30:40.872280 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5144e5-143d-4370-b380-31e2c842c658 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:30:40.878016 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 410/837] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Aug 18 19:30:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:30:40.883793 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0640a316-3b58-4a5c-8c90-6108d1435bfe None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:30:40.957413 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:30:40.992868 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0640a316-3b58-4a5c-8c90-6108d1435bfe None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:30:41.027548 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debc6808-4155-4e2c-97e5-e6066f2f3fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:30:41.028243 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc6808-4155-4e2c-97e5-e6066f2f3fec None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:30:41.028534 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc6808-4155-4e2c-97e5-e6066f2f3fec None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:30:41.028807 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc6808-4155-4e2c-97e5-e6066f2f3fec None admin] PATH_INFO: `/v3/projects/service` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:30:41.035671 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debc6808-4155-4e2c-97e5-e6066f2f3fec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:30:41.037108 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debc6808-4155-4e2c-97e5-e6066f2f3fec None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:30:41.049031 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application [None req-debc6808-4155-4e2c-97e5-e6066f2f3fec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 19:30:41.049031 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:30:41.049031 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:30:41.049031 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:30:41.049031 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:30:41.049031 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:30:41.049031 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:30:41.049031 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:30:41.049031 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:30:41.049031 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:30:41.049031 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:30:41.049031 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:30:41.049031 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 19:30:41.049031 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 19:30:41.049031 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 19:30:41.050152 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 19:30:41.050152 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:30:41.050152 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:30:41.050152 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:30:41.050152 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:30:41.050152 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:30:41.050152 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:30:41.050152 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:30:41.050152 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application with Lock( Aug 18 19:30:41.050152 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:30:41.050152 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:30:41.050152 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:30:41.050152 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:30:41.050152 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:30:41.050152 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:30:41.050152 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:30:41.050152 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:30:41.051220 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 19:30:41.051220 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 19:30:41.051220 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 19:30:41.051220 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 19:30:41.051220 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 19:30:41.051220 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 19:30:41.051220 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 19:30:41.051220 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:30:41.051220 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 428/838] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Aug 18 19:30:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:30:41.056113 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5144e5-143d-4370-b380-31e2c842c658 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:30:41.158881 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5144e5-143d-4370-b380-31e2c842c658 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:30:41.175776 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:30:41.192431 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9482c54-2bea-4b7f-b4fd-9ae6f52a7914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:30:41.193034 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9482c54-2bea-4b7f-b4fd-9ae6f52a7914 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:30:41.193311 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9482c54-2bea-4b7f-b4fd-9ae6f52a7914 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:30:41.193582 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9482c54-2bea-4b7f-b4fd-9ae6f52a7914 None admin] PATH_INFO: `/v3/projects` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:30:41.194309 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9482c54-2bea-4b7f-b4fd-9ae6f52a7914 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:30:41.194613 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9482c54-2bea-4b7f-b4fd-9ae6f52a7914 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:30:41.196023 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9482c54-2bea-4b7f-b4fd-9ae6f52a7914 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:30:41.208423 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 411/839] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Aug 18 19:30:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:30:41.214552 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debc6808-4155-4e2c-97e5-e6066f2f3fec None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:30:41.317260 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debc6808-4155-4e2c-97e5-e6066f2f3fec None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:30:41.345918 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:30:41.351610 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ac30ca-c32a-4492-bb0d-ce7edcc9960a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:30:41.352204 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac30ca-c32a-4492-bb0d-ce7edcc9960a None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:30:41.352481 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac30ca-c32a-4492-bb0d-ce7edcc9960a None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:30:41.352749 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac30ca-c32a-4492-bb0d-ce7edcc9960a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:30:41.353453 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ac30ca-c32a-4492-bb0d-ce7edcc9960a None admin] RBAC: Adding query filter params (role.id=2a89ce9253da431fb2d0bf1ff51e1426, scope.project.id=a44b197c3aa0479092f4d77d2c791c39, user.id=b80a74afafd94acd8703fda561e1e4cd) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:30:41.353790 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ac30ca-c32a-4492-bb0d-ce7edcc9960a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:30:41.355779 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ac30ca-c32a-4492-bb0d-ce7edcc9960a None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:30:41.360928 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 429/840] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Aug 18 19:30:41 2022] GET /identity/v3/role_assignments?user.id=b80a74afafd94acd8703fda561e1e4cd&scope.project.id=a44b197c3aa0479092f4d77d2c791c39&role.id=2a89ce9253da431fb2d0bf1ff51e1426 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:30:43.484138 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e03c721-f83a-4b54-af39-e1f801ab3f65 None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:30:43.484703 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e03c721-f83a-4b54-af39-e1f801ab3f65 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:30:43.484703 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e03c721-f83a-4b54-af39-e1f801ab3f65 None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:30:43.486056 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 412/841] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:30:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:30:43.491126 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d51bc9-0ac1-4803-ae8c-118c4a2f3b49 None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:30:43.491539 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d51bc9-0ac1-4803-ae8c-118c4a2f3b49 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:30:43.491673 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d51bc9-0ac1-4803-ae8c-118c4a2f3b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:30:43.509344 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-51d51bc9-0ac1-4803-ae8c-118c4a2f3b49 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:30:43.510549 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-51d51bc9-0ac1-4803-ae8c-118c4a2f3b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:30:43.574396 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 430/842] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:30:43 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 19:30:43.898980 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e03c721-f83a-4b54-af39-e1f801ab3f65 None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:30:43.998832 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e03c721-f83a-4b54-af39-e1f801ab3f65 None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:30:44.039816 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7154aa-67aa-4e97-9f67-e28f5f4841de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:30:44.040975 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7154aa-67aa-4e97-9f67-e28f5f4841de None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:30:44.041255 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7154aa-67aa-4e97-9f67-e28f5f4841de None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:30:44.041526 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7154aa-67aa-4e97-9f67-e28f5f4841de None admin] PATH_INFO: `/v3/roles/service` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:30:44.052180 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7154aa-67aa-4e97-9f67-e28f5f4841de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:30:44.056866 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application [None req-ce7154aa-67aa-4e97-9f67-e28f5f4841de None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 19:30:44.056866 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:30:44.056866 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:30:44.056866 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:30:44.056866 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:30:44.056866 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:30:44.056866 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:30:44.056866 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:30:44.056866 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:30:44.056866 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:30:44.056866 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:30:44.056866 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:30:44.056866 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:30:44.056866 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:30:44.056866 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:30:44.056866 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:30:44.058640 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:30:44.058640 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:30:44.058640 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:30:44.058640 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:30:44.058640 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:30:44.058640 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:30:44.058640 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:30:44.058640 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:30:44.058640 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:30:44.058640 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:30:44.058640 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:30:44.058640 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application with Lock( Aug 18 19:30:44.058640 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:30:44.058640 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:30:44.058640 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:30:44.058640 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:30:44.059986 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:30:44.059986 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:30:44.059986 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:30:44.059986 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:30:44.059986 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:30:44.059986 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:30:44.059986 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:30:44.059986 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:30:44.059986 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:30:44.059986 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:30:44.059986 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 19:30:44.059986 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:30:44.059986 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 413/843] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Aug 18 19:30:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:30:44.067711 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d51bc9-0ac1-4803-ae8c-118c4a2f3b49 None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:30:44.163631 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d51bc9-0ac1-4803-ae8c-118c4a2f3b49 None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:30:44.185861 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:30:44.196468 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ae3ffa-7e1e-46f0-818b-7046148d54de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:30:44.197124 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae3ffa-7e1e-46f0-818b-7046148d54de None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:30:44.197404 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae3ffa-7e1e-46f0-818b-7046148d54de None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:30:44.197693 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae3ffa-7e1e-46f0-818b-7046148d54de None admin] PATH_INFO: `/v3/roles` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:30:44.198388 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ae3ffa-7e1e-46f0-818b-7046148d54de None admin] RBAC: Adding query filter params (name=service) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:30:44.199448 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ae3ffa-7e1e-46f0-818b-7046148d54de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:30:44.200208 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ae3ffa-7e1e-46f0-818b-7046148d54de None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:30:44.208990 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 431/844] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Aug 18 19:30:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:30:44.215370 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7154aa-67aa-4e97-9f67-e28f5f4841de None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:30:44.255327 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:30:44.313609 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7154aa-67aa-4e97-9f67-e28f5f4841de None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:30:44.347648 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1130faa0-5204-456a-88b1-56b9812e8161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:30:44.348268 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1130faa0-5204-456a-88b1-56b9812e8161 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:30:44.348545 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1130faa0-5204-456a-88b1-56b9812e8161 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:30:44.348817 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1130faa0-5204-456a-88b1-56b9812e8161 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:30:44.359128 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1130faa0-5204-456a-88b1-56b9812e8161 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:30:44.360557 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1130faa0-5204-456a-88b1-56b9812e8161 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:30:44.374599 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application [None req-1130faa0-5204-456a-88b1-56b9812e8161 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:30:44.374599 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:30:44.374599 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:30:44.374599 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:30:44.374599 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:30:44.374599 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:30:44.374599 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:30:44.374599 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:30:44.374599 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:30:44.374599 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:30:44.374599 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:30:44.374599 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:30:44.374599 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 19:30:44.374599 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 19:30:44.374599 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 19:30:44.374599 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 19:30:44.375691 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:30:44.375691 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:30:44.375691 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:30:44.375691 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:30:44.375691 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:30:44.375691 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:30:44.375691 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:30:44.375691 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application with Lock( Aug 18 19:30:44.375691 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:30:44.375691 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:30:44.375691 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:30:44.375691 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:30:44.375691 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:30:44.375691 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:30:44.375691 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:30:44.375691 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:30:44.375691 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 19:30:44.376926 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 19:30:44.376926 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:30:44.376926 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:30:44.376926 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 414/845] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Aug 18 19:30:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:30:44.381672 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ae3ffa-7e1e-46f0-818b-7046148d54de None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:30:44.479229 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ae3ffa-7e1e-46f0-818b-7046148d54de None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:30:44.512571 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ba80d5-53c5-48db-a520-b554f2eba89e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:30:44.513191 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba80d5-53c5-48db-a520-b554f2eba89e None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:30:44.513456 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba80d5-53c5-48db-a520-b554f2eba89e None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:30:44.513818 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba80d5-53c5-48db-a520-b554f2eba89e None admin] PATH_INFO: `/v3/domains` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:30:44.514444 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ba80d5-53c5-48db-a520-b554f2eba89e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:30:44.514741 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ba80d5-53c5-48db-a520-b554f2eba89e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:30:44.516083 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ba80d5-53c5-48db-a520-b554f2eba89e None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:30:44.527957 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 432/846] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Aug 18 19:30:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:30:44.533794 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1130faa0-5204-456a-88b1-56b9812e8161 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:30:44.622009 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:30:44.630875 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1130faa0-5204-456a-88b1-56b9812e8161 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:30:44.663668 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e22639-c7c0-4e5c-a24f-ca843f54de98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:30:44.664294 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e22639-c7c0-4e5c-a24f-ca843f54de98 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:30:44.664573 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e22639-c7c0-4e5c-a24f-ca843f54de98 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:30:44.664842 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e22639-c7c0-4e5c-a24f-ca843f54de98 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:30:44.672046 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e22639-c7c0-4e5c-a24f-ca843f54de98 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:30:44.673463 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e22639-c7c0-4e5c-a24f-ca843f54de98 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:30:44.684332 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application [None req-b8e22639-c7c0-4e5c-a24f-ca843f54de98 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 18 19:30:44.684332 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:30:44.684332 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:30:44.684332 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:30:44.684332 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:30:44.684332 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:30:44.684332 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:30:44.684332 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:30:44.684332 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:30:44.684332 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:30:44.684332 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:30:44.684332 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:30:44.684332 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 19:30:44.684332 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 19:30:44.684332 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 19:30:44.684332 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 19:30:44.685483 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:30:44.685483 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:30:44.685483 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 19:30:44.685483 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 19:30:44.685483 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 19:30:44.685483 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 19:30:44.685483 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:30:44.685483 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:30:44.685483 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:30:44.685483 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:30:44.685483 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:30:44.685483 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application with Lock( Aug 18 19:30:44.685483 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:30:44.685483 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:30:44.685483 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:30:44.685483 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:30:44.685483 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:30:44.685483 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:30:44.686767 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:30:44.686767 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:30:44.686767 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 19:30:44.686767 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 19:30:44.686767 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 19:30:44.686767 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 19:30:44.686767 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 19:30:44.686767 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 19:30:44.686767 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 18 19:30:44.686767 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:30:44.686767 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 415/847] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Aug 18 19:30:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:30:44.691288 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ba80d5-53c5-48db-a520-b554f2eba89e None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:30:44.738139 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:30:44.790548 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ba80d5-53c5-48db-a520-b554f2eba89e None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:30:44.825695 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccf0aa7-0b68-4516-9e7d-6c4233afffab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:30:44.826354 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf0aa7-0b68-4516-9e7d-6c4233afffab None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:30:44.826633 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf0aa7-0b68-4516-9e7d-6c4233afffab None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:30:44.826934 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf0aa7-0b68-4516-9e7d-6c4233afffab None admin] PATH_INFO: `/v3/users` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:30:44.827652 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccf0aa7-0b68-4516-9e7d-6c4233afffab None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:30:44.827957 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccf0aa7-0b68-4516-9e7d-6c4233afffab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:30:44.829380 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccf0aa7-0b68-4516-9e7d-6c4233afffab None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:30:44.846508 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 433/848] 10.222.0.23 () {56 vars in 1143 bytes} [Thu Aug 18 19:30:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:30:44.852163 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e22639-c7c0-4e5c-a24f-ca843f54de98 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:30:44.950681 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e22639-c7c0-4e5c-a24f-ca843f54de98 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:30:44.984927 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e9520b-f02b-4841-b7ce-2b545ad38e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:30:44.985552 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e9520b-f02b-4841-b7ce-2b545ad38e19 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:30:44.985930 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e9520b-f02b-4841-b7ce-2b545ad38e19 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:30:44.986190 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e9520b-f02b-4841-b7ce-2b545ad38e19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:30:44.997356 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e9520b-f02b-4841-b7ce-2b545ad38e19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:30:44.998759 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e9520b-f02b-4841-b7ce-2b545ad38e19 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:30:45.013599 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application [None req-e4e9520b-f02b-4841-b7ce-2b545ad38e19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:30:45.013599 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:30:45.013599 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:30:45.013599 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:30:45.013599 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:30:45.013599 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:30:45.013599 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:30:45.013599 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:30:45.013599 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:30:45.013599 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:30:45.013599 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:30:45.013599 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:30:45.013599 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 19:30:45.013599 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 19:30:45.013599 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 19:30:45.013599 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 19:30:45.014790 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:30:45.014790 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:30:45.014790 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:30:45.014790 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:30:45.014790 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:30:45.014790 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:30:45.014790 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:30:45.014790 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application with Lock( Aug 18 19:30:45.014790 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:30:45.014790 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:30:45.014790 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:30:45.014790 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:30:45.014790 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:30:45.014790 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:30:45.014790 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:30:45.014790 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:30:45.014790 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 19:30:45.015666 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 19:30:45.015666 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:30:45.015666 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:30:45.015666 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 416/849] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Aug 18 19:30:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:30:45.020654 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccf0aa7-0b68-4516-9e7d-6c4233afffab None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:30:45.119456 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccf0aa7-0b68-4516-9e7d-6c4233afffab None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:30:45.122395 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:30:45.155192 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171c75f2-ea4a-4139-a0f1-2b226d94782e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:30:45.155796 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171c75f2-ea4a-4139-a0f1-2b226d94782e None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:30:45.156075 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171c75f2-ea4a-4139-a0f1-2b226d94782e None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:30:45.156345 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171c75f2-ea4a-4139-a0f1-2b226d94782e None admin] PATH_INFO: `/v3/domains` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:30:45.156986 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171c75f2-ea4a-4139-a0f1-2b226d94782e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:30:45.157289 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171c75f2-ea4a-4139-a0f1-2b226d94782e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:30:45.158692 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171c75f2-ea4a-4139-a0f1-2b226d94782e None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:30:45.170618 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 434/850] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Aug 18 19:30:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:30:45.175386 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e9520b-f02b-4841-b7ce-2b545ad38e19 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:30:45.178350 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:30:45.275294 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e9520b-f02b-4841-b7ce-2b545ad38e19 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:30:45.308978 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28fde51-fe7b-4fa7-9f3b-de20d26600e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:30:45.309618 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28fde51-fe7b-4fa7-9f3b-de20d26600e7 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:30:45.309924 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28fde51-fe7b-4fa7-9f3b-de20d26600e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:30:45.310237 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28fde51-fe7b-4fa7-9f3b-de20d26600e7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:30:45.316728 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28fde51-fe7b-4fa7-9f3b-de20d26600e7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:30:45.318220 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28fde51-fe7b-4fa7-9f3b-de20d26600e7 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:30:45.329164 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application [None req-c28fde51-fe7b-4fa7-9f3b-de20d26600e7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 19:30:45.329164 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:30:45.329164 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:30:45.329164 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:30:45.329164 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:30:45.329164 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:30:45.329164 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:30:45.329164 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:30:45.329164 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:30:45.329164 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:30:45.329164 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:30:45.329164 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:30:45.329164 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 19:30:45.329164 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 19:30:45.329164 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 19:30:45.330514 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 19:30:45.330514 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:30:45.330514 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:30:45.330514 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:30:45.330514 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:30:45.330514 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:30:45.330514 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:30:45.330514 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:30:45.330514 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application with Lock( Aug 18 19:30:45.330514 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:30:45.330514 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:30:45.330514 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:30:45.330514 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:30:45.330514 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:30:45.330514 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:30:45.330514 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:30:45.330514 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:30:45.331636 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 19:30:45.331636 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 19:30:45.331636 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 19:30:45.331636 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 19:30:45.331636 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 19:30:45.331636 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 19:30:45.331636 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 19:30:45.331636 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:30:45.331636 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 417/851] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Aug 18 19:30:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:30:45.336506 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171c75f2-ea4a-4139-a0f1-2b226d94782e None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:30:45.435091 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171c75f2-ea4a-4139-a0f1-2b226d94782e None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:30:45.467093 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d98a40d-ff59-4fb3-842d-37f26a83ef81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:30:45.467692 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d98a40d-ff59-4fb3-842d-37f26a83ef81 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:30:45.467972 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d98a40d-ff59-4fb3-842d-37f26a83ef81 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:30:45.468242 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d98a40d-ff59-4fb3-842d-37f26a83ef81 None admin] PATH_INFO: `/v3/projects` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:30:45.468921 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d98a40d-ff59-4fb3-842d-37f26a83ef81 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:30:45.469221 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d98a40d-ff59-4fb3-842d-37f26a83ef81 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:30:45.470662 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d98a40d-ff59-4fb3-842d-37f26a83ef81 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:30:45.483333 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 435/852] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Aug 18 19:30:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:30:45.489520 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28fde51-fe7b-4fa7-9f3b-de20d26600e7 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:30:45.550140 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:30:45.589428 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28fde51-fe7b-4fa7-9f3b-de20d26600e7 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:30:45.622039 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1250f9d3-b170-4eb6-b745-5b9e4c8e5120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:30:45.622684 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1250f9d3-b170-4eb6-b745-5b9e4c8e5120 None admin] REQUEST_METHOD: `PUT` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:30:45.622964 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1250f9d3-b170-4eb6-b745-5b9e4c8e5120 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:30:45.623235 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1250f9d3-b170-4eb6-b745-5b9e4c8e5120 None admin] PATH_INFO: `/v3/projects/a44b197c3aa0479092f4d77d2c791c39/users/b80a74afafd94acd8703fda561e1e4cd/roles/2a89ce9253da431fb2d0bf1ff51e1426` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:30:45.637053 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1250f9d3-b170-4eb6-b745-5b9e4c8e5120 None admin] RBAC: Authorizing `identity:create_grant(project_id=a44b197c3aa0479092f4d77d2c791c39, user_id=b80a74afafd94acd8703fda561e1e4cd, role_id=2a89ce9253da431fb2d0bf1ff51e1426)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:30:45.638503 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1250f9d3-b170-4eb6-b745-5b9e4c8e5120 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:30:45.695401 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 418/853] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Aug 18 19:30:45 2022] PUT /identity/v3/projects/a44b197c3aa0479092f4d77d2c791c39/users/b80a74afafd94acd8703fda561e1e4cd/roles/2a89ce9253da431fb2d0bf1ff51e1426 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 19:30:47.831147 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd193ebf-ee64-40dd-a5f9-dafca0e88b4c None None] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:30:47.831687 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd193ebf-ee64-40dd-a5f9-dafca0e88b4c None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:30:47.831823 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd193ebf-ee64-40dd-a5f9-dafca0e88b4c None None] PATH_INFO: `/` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:30:47.833113 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 436/854] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:30:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:30:47.838944 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9f112e-6af9-4a50-9eb8-f62b13117786 None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:30:47.839403 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9f112e-6af9-4a50-9eb8-f62b13117786 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:30:47.839534 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9f112e-6af9-4a50-9eb8-f62b13117786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:30:47.858021 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-af9f112e-6af9-4a50-9eb8-f62b13117786 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:30:47.859217 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-af9f112e-6af9-4a50-9eb8-f62b13117786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:30:47.926636 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 419/855] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:30:47 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 19:30:48.272973 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd193ebf-ee64-40dd-a5f9-dafca0e88b4c None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:30:48.299587 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:30:48.376645 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd193ebf-ee64-40dd-a5f9-dafca0e88b4c None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:30:48.411110 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198ff64f-a558-403b-97d4-9eb4c8b3e69a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:30:48.411734 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198ff64f-a558-403b-97d4-9eb4c8b3e69a None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:30:48.412006 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198ff64f-a558-403b-97d4-9eb4c8b3e69a None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:30:48.412272 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198ff64f-a558-403b-97d4-9eb4c8b3e69a None admin] PATH_INFO: `/v3/roles/service` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:30:48.423832 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198ff64f-a558-403b-97d4-9eb4c8b3e69a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:30:48.428768 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application [None req-198ff64f-a558-403b-97d4-9eb4c8b3e69a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 19:30:48.428768 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:30:48.428768 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:30:48.428768 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:30:48.428768 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:30:48.428768 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:30:48.428768 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:30:48.428768 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:30:48.428768 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:30:48.428768 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:30:48.428768 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:30:48.428768 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:30:48.428768 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:30:48.428768 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:30:48.428768 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:30:48.428768 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:30:48.429876 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:30:48.429876 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:30:48.429876 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:30:48.429876 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:30:48.429876 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:30:48.429876 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:30:48.429876 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:30:48.429876 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:30:48.429876 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:30:48.429876 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:30:48.429876 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:30:48.429876 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application with Lock( Aug 18 19:30:48.429876 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:30:48.429876 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:30:48.429876 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:30:48.429876 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:30:48.430753 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:30:48.430753 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:30:48.430753 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:30:48.430753 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:30:48.430753 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:30:48.430753 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:30:48.430753 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:30:48.430753 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:30:48.430753 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:30:48.430753 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:30:48.430753 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 19:30:48.430753 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:30:48.430753 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 437/856] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Aug 18 19:30:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:30:48.436692 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9f112e-6af9-4a50-9eb8-f62b13117786 None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:30:48.480110 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:30:48.534488 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9f112e-6af9-4a50-9eb8-f62b13117786 None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:30:48.567192 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6a82b9-311a-4228-8b8a-c09b3b8706a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:30:48.567787 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6a82b9-311a-4228-8b8a-c09b3b8706a8 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:30:48.568067 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6a82b9-311a-4228-8b8a-c09b3b8706a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:30:48.568338 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6a82b9-311a-4228-8b8a-c09b3b8706a8 None admin] PATH_INFO: `/v3/roles` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:30:48.568989 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6a82b9-311a-4228-8b8a-c09b3b8706a8 None admin] RBAC: Adding query filter params (name=service) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:30:48.569289 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6a82b9-311a-4228-8b8a-c09b3b8706a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:30:48.570677 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6a82b9-311a-4228-8b8a-c09b3b8706a8 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:30:48.578762 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 420/857] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Aug 18 19:30:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:30:48.584739 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198ff64f-a558-403b-97d4-9eb4c8b3e69a None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:30:48.668951 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:30:48.684348 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198ff64f-a558-403b-97d4-9eb4c8b3e69a None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:30:48.717998 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c740d3-9d89-4838-8524-8c9ec582eaa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:30:48.718610 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c740d3-9d89-4838-8524-8c9ec582eaa1 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:30:48.718883 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c740d3-9d89-4838-8524-8c9ec582eaa1 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:30:48.719152 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c740d3-9d89-4838-8524-8c9ec582eaa1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:30:48.728792 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c740d3-9d89-4838-8524-8c9ec582eaa1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:30:48.731000 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c740d3-9d89-4838-8524-8c9ec582eaa1 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:30:48.745262 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application [None req-f2c740d3-9d89-4838-8524-8c9ec582eaa1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:30:48.745262 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:30:48.745262 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:30:48.745262 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:30:48.745262 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:30:48.745262 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:30:48.745262 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:30:48.745262 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:30:48.745262 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:30:48.745262 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:30:48.745262 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:30:48.745262 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:30:48.745262 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 19:30:48.745262 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 19:30:48.745262 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 19:30:48.745262 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 19:30:48.746394 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:30:48.746394 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:30:48.746394 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:30:48.746394 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:30:48.746394 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:30:48.746394 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:30:48.746394 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:30:48.746394 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application with Lock( Aug 18 19:30:48.746394 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:30:48.746394 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:30:48.746394 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:30:48.746394 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:30:48.746394 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:30:48.746394 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:30:48.746394 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:30:48.746394 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:30:48.746394 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 19:30:48.747443 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 19:30:48.747443 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:30:48.747443 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:30:48.747443 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 438/858] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Aug 18 19:30:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:30:48.752172 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6a82b9-311a-4228-8b8a-c09b3b8706a8 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:30:48.851354 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6a82b9-311a-4228-8b8a-c09b3b8706a8 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:30:48.853561 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:30:48.884467 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efe1491-7897-4f7c-89d5-63db8e14c76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:30:48.885072 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe1491-7897-4f7c-89d5-63db8e14c76b None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:30:48.885377 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe1491-7897-4f7c-89d5-63db8e14c76b None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:30:48.885678 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe1491-7897-4f7c-89d5-63db8e14c76b None admin] PATH_INFO: `/v3/domains` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:30:48.886343 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efe1491-7897-4f7c-89d5-63db8e14c76b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:30:48.886648 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efe1491-7897-4f7c-89d5-63db8e14c76b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:30:48.887993 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efe1491-7897-4f7c-89d5-63db8e14c76b None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:30:48.899344 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 421/859] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Aug 18 19:30:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 19:30:48.905553 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c740d3-9d89-4838-8524-8c9ec582eaa1 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:30:49.004413 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c740d3-9d89-4838-8524-8c9ec582eaa1 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:30:49.037754 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762afa79-9b14-42c7-8c65-1697f892e1dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:30:49.038284 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762afa79-9b14-42c7-8c65-1697f892e1dc None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:30:49.038566 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762afa79-9b14-42c7-8c65-1697f892e1dc None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:30:49.038832 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762afa79-9b14-42c7-8c65-1697f892e1dc None admin] PATH_INFO: `/v3/users/placement` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:30:49.041430 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:30:49.047443 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762afa79-9b14-42c7-8c65-1697f892e1dc None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:30:49.048888 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762afa79-9b14-42c7-8c65-1697f892e1dc None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:30:49.059839 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application [None req-762afa79-9b14-42c7-8c65-1697f892e1dc None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 18 19:30:49.059839 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:30:49.059839 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:30:49.059839 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:30:49.059839 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:30:49.059839 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:30:49.059839 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:30:49.059839 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:30:49.059839 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:30:49.059839 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:30:49.059839 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:30:49.059839 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:30:49.059839 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 19:30:49.059839 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 19:30:49.059839 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 19:30:49.059839 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 19:30:49.060951 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:30:49.060951 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:30:49.060951 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 19:30:49.060951 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 19:30:49.060951 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 19:30:49.060951 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 19:30:49.060951 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:30:49.060951 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:30:49.060951 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:30:49.060951 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:30:49.060951 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:30:49.060951 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application with Lock( Aug 18 19:30:49.060951 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:30:49.060951 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:30:49.060951 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:30:49.060951 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:30:49.060951 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:30:49.060951 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:30:49.062017 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:30:49.062017 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:30:49.062017 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 19:30:49.062017 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 19:30:49.062017 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 19:30:49.062017 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 19:30:49.062017 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 19:30:49.062017 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 19:30:49.062017 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 18 19:30:49.062017 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:30:49.062017 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 439/860] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Aug 18 19:30:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:30:49.073582 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efe1491-7897-4f7c-89d5-63db8e14c76b None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:30:49.167483 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efe1491-7897-4f7c-89d5-63db8e14c76b None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:30:49.200979 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45723b27-34bc-4f16-8e1f-cd70a3a0f5ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:30:49.201577 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45723b27-34bc-4f16-8e1f-cd70a3a0f5ac None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:30:49.201885 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45723b27-34bc-4f16-8e1f-cd70a3a0f5ac None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:30:49.202158 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45723b27-34bc-4f16-8e1f-cd70a3a0f5ac None admin] PATH_INFO: `/v3/users` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:30:49.202913 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45723b27-34bc-4f16-8e1f-cd70a3a0f5ac None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:30:49.203219 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45723b27-34bc-4f16-8e1f-cd70a3a0f5ac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:30:49.204627 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45723b27-34bc-4f16-8e1f-cd70a3a0f5ac None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:30:49.224040 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 422/861] 10.222.0.23 () {56 vars in 1143 bytes} [Thu Aug 18 19:30:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:30:49.229946 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762afa79-9b14-42c7-8c65-1697f892e1dc None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:30:49.333326 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762afa79-9b14-42c7-8c65-1697f892e1dc None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:30:49.365676 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5855ab54-95e5-4244-b66b-cc4baddde214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:30:49.366296 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5855ab54-95e5-4244-b66b-cc4baddde214 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:30:49.366575 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5855ab54-95e5-4244-b66b-cc4baddde214 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:30:49.366848 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5855ab54-95e5-4244-b66b-cc4baddde214 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:30:49.425860 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:30:49.432590 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5855ab54-95e5-4244-b66b-cc4baddde214 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:30:49.434102 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5855ab54-95e5-4244-b66b-cc4baddde214 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:30:49.529334 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 440/862] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Aug 18 19:30:49 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 19:30:49.535196 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45723b27-34bc-4f16-8e1f-cd70a3a0f5ac None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:30:49.559414 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:30:49.632404 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45723b27-34bc-4f16-8e1f-cd70a3a0f5ac None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:30:49.665612 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add37a8c-5a0b-4537-8620-ed94dc119641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:30:49.666263 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add37a8c-5a0b-4537-8620-ed94dc119641 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:30:49.666543 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add37a8c-5a0b-4537-8620-ed94dc119641 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:30:49.666814 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add37a8c-5a0b-4537-8620-ed94dc119641 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:30:49.676469 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add37a8c-5a0b-4537-8620-ed94dc119641 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:30:49.677946 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add37a8c-5a0b-4537-8620-ed94dc119641 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:30:49.693540 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application [None req-add37a8c-5a0b-4537-8620-ed94dc119641 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:30:49.693540 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:30:49.693540 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:30:49.693540 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:30:49.693540 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:30:49.693540 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:30:49.693540 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:30:49.693540 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:30:49.693540 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:30:49.693540 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:30:49.693540 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:30:49.693540 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:30:49.693540 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 19:30:49.693540 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 19:30:49.693540 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 19:30:49.693540 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 19:30:49.694916 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:30:49.694916 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:30:49.694916 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:30:49.694916 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:30:49.694916 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:30:49.694916 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:30:49.694916 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:30:49.694916 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application with Lock( Aug 18 19:30:49.694916 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:30:49.694916 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:30:49.694916 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:30:49.694916 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:30:49.694916 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:30:49.694916 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:30:49.694916 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:30:49.694916 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:30:49.694916 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 19:30:49.695801 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 19:30:49.695801 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:30:49.695801 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:30:49.695801 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 423/863] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Aug 18 19:30:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:30:49.701162 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5855ab54-95e5-4244-b66b-cc4baddde214 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:30:49.792714 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:30:49.798386 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5855ab54-95e5-4244-b66b-cc4baddde214 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:30:49.831611 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ced2be-4a12-453a-af83-27bcbab59602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:30:49.832250 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ced2be-4a12-453a-af83-27bcbab59602 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:30:49.832525 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ced2be-4a12-453a-af83-27bcbab59602 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:30:49.832797 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ced2be-4a12-453a-af83-27bcbab59602 None admin] PATH_INFO: `/v3/domains` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:30:49.833422 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ced2be-4a12-453a-af83-27bcbab59602 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:30:49.833751 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ced2be-4a12-453a-af83-27bcbab59602 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:30:49.835222 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ced2be-4a12-453a-af83-27bcbab59602 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:30:49.846255 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 441/864] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Aug 18 19:30:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:30:49.852042 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add37a8c-5a0b-4537-8620-ed94dc119641 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:30:49.927659 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:30:49.951766 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add37a8c-5a0b-4537-8620-ed94dc119641 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:30:49.984247 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe82208-38e2-4b19-8594-d0a9fac98fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:30:49.984863 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe82208-38e2-4b19-8594-d0a9fac98fea None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:30:49.985139 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe82208-38e2-4b19-8594-d0a9fac98fea None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:30:49.985409 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe82208-38e2-4b19-8594-d0a9fac98fea None admin] PATH_INFO: `/v3/projects/service` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:30:49.991742 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe82208-38e2-4b19-8594-d0a9fac98fea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:30:49.993223 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe82208-38e2-4b19-8594-d0a9fac98fea None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:30:50.004615 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application [None req-0fe82208-38e2-4b19-8594-d0a9fac98fea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 19:30:50.004615 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:30:50.004615 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:30:50.004615 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:30:50.004615 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:30:50.004615 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:30:50.004615 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:30:50.004615 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:30:50.004615 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:30:50.004615 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:30:50.004615 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:30:50.004615 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:30:50.004615 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 19:30:50.004615 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 19:30:50.004615 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 19:30:50.005643 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 19:30:50.005643 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:30:50.005643 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:30:50.005643 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:30:50.005643 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:30:50.005643 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:30:50.005643 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:30:50.005643 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:30:50.005643 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application with Lock( Aug 18 19:30:50.005643 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:30:50.005643 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:30:50.005643 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:30:50.005643 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:30:50.005643 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:30:50.005643 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:30:50.005643 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:30:50.005643 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:30:50.006718 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 19:30:50.006718 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 19:30:50.006718 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 19:30:50.006718 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 19:30:50.006718 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 19:30:50.006718 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 19:30:50.006718 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 19:30:50.006718 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:30:50.006718 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 424/865] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Aug 18 19:30:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:30:50.011706 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ced2be-4a12-453a-af83-27bcbab59602 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:30:50.114521 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ced2be-4a12-453a-af83-27bcbab59602 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:30:50.146877 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6d4d9c-935c-4623-8253-7013801626ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:30:50.147472 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6d4d9c-935c-4623-8253-7013801626ae None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:30:50.147749 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6d4d9c-935c-4623-8253-7013801626ae None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:30:50.148019 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6d4d9c-935c-4623-8253-7013801626ae None admin] PATH_INFO: `/v3/projects` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:30:50.148743 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6d4d9c-935c-4623-8253-7013801626ae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:30:50.149046 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6d4d9c-935c-4623-8253-7013801626ae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:30:50.150486 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6d4d9c-935c-4623-8253-7013801626ae None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:30:50.162818 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 442/866] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Aug 18 19:30:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:30:50.169488 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe82208-38e2-4b19-8594-d0a9fac98fea None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:30:50.268772 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe82208-38e2-4b19-8594-d0a9fac98fea None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:30:50.301754 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4581dd-dd17-4ccf-a387-99627e3ac59c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:30:50.302344 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4581dd-dd17-4ccf-a387-99627e3ac59c None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:30:50.302621 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4581dd-dd17-4ccf-a387-99627e3ac59c None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:30:50.302892 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4581dd-dd17-4ccf-a387-99627e3ac59c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:30:50.303600 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4581dd-dd17-4ccf-a387-99627e3ac59c None admin] RBAC: Adding query filter params (role.id=2a89ce9253da431fb2d0bf1ff51e1426, scope.project.id=a44b197c3aa0479092f4d77d2c791c39, user.id=b80a74afafd94acd8703fda561e1e4cd) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:30:50.303904 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4581dd-dd17-4ccf-a387-99627e3ac59c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:30:50.305307 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4581dd-dd17-4ccf-a387-99627e3ac59c None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:30:50.307079 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:30:50.311482 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 425/867] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Aug 18 19:30:50 2022] GET /identity/v3/role_assignments?user.id=b80a74afafd94acd8703fda561e1e4cd&scope.project.id=a44b197c3aa0479092f4d77d2c791c39&role.id=2a89ce9253da431fb2d0bf1ff51e1426 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:30:52.544485 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b33dd3b-f459-4ba9-881a-c3ad930d1f04 None None] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:30:52.545024 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b33dd3b-f459-4ba9-881a-c3ad930d1f04 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:30:52.545116 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b33dd3b-f459-4ba9-881a-c3ad930d1f04 None None] PATH_INFO: `/` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:30:52.546879 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 443/868] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:30:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:30:52.552179 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d1ccb3-7f0e-4c0a-9474-59da695e8589 None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:30:52.553912 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d1ccb3-7f0e-4c0a-9474-59da695e8589 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:30:52.553912 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d1ccb3-7f0e-4c0a-9474-59da695e8589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:30:52.571031 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-b6d1ccb3-7f0e-4c0a-9474-59da695e8589 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:30:52.572272 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-b6d1ccb3-7f0e-4c0a-9474-59da695e8589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:30:52.639112 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 426/869] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:30:52 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 19:30:52.963169 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b33dd3b-f459-4ba9-881a-c3ad930d1f04 None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:30:52.981886 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:30:53.065268 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b33dd3b-f459-4ba9-881a-c3ad930d1f04 None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:30:53.100287 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0313564d-72ea-4d5b-9272-e8278edc5e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:30:53.100908 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0313564d-72ea-4d5b-9272-e8278edc5e50 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:30:53.101185 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0313564d-72ea-4d5b-9272-e8278edc5e50 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:30:53.101454 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0313564d-72ea-4d5b-9272-e8278edc5e50 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:30:53.111367 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0313564d-72ea-4d5b-9272-e8278edc5e50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:30:53.116052 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application [None req-0313564d-72ea-4d5b-9272-e8278edc5e50 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 19:30:53.116052 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:30:53.116052 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:30:53.116052 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:30:53.116052 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:30:53.116052 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:30:53.116052 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:30:53.116052 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:30:53.116052 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:30:53.116052 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:30:53.116052 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:30:53.116052 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:30:53.116052 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:30:53.116052 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:30:53.116052 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:30:53.116052 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:30:53.117162 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:30:53.117162 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:30:53.117162 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:30:53.117162 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:30:53.117162 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:30:53.117162 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:30:53.117162 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:30:53.117162 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:30:53.117162 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:30:53.117162 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:30:53.117162 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:30:53.117162 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application with Lock( Aug 18 19:30:53.117162 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:30:53.117162 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:30:53.117162 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:30:53.117162 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:30:53.118047 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:30:53.118047 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:30:53.118047 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:30:53.118047 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:30:53.118047 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:30:53.118047 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:30:53.118047 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:30:53.118047 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:30:53.118047 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:30:53.118047 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:30:53.118047 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 19:30:53.118047 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:30:53.121811 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 444/870] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Aug 18 19:30:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:30:53.123808 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d1ccb3-7f0e-4c0a-9474-59da695e8589 None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:30:53.220264 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d1ccb3-7f0e-4c0a-9474-59da695e8589 None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:30:53.246173 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:30:53.253884 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e022a776-35a7-4c1d-a818-233f7b61df69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:30:53.254487 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e022a776-35a7-4c1d-a818-233f7b61df69 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:30:53.254764 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e022a776-35a7-4c1d-a818-233f7b61df69 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:30:53.255032 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e022a776-35a7-4c1d-a818-233f7b61df69 None admin] PATH_INFO: `/v3/roles` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:30:53.255691 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e022a776-35a7-4c1d-a818-233f7b61df69 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:30:53.255993 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e022a776-35a7-4c1d-a818-233f7b61df69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:30:53.257347 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e022a776-35a7-4c1d-a818-233f7b61df69 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:30:53.266127 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 427/871] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Aug 18 19:30:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:30:53.271814 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0313564d-72ea-4d5b-9272-e8278edc5e50 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:30:53.350898 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:30:53.373621 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0313564d-72ea-4d5b-9272-e8278edc5e50 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:30:53.407061 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfa2636-e0b6-47ef-99b1-0da9f9184620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:30:53.407681 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfa2636-e0b6-47ef-99b1-0da9f9184620 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:30:53.407961 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfa2636-e0b6-47ef-99b1-0da9f9184620 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:30:53.408232 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfa2636-e0b6-47ef-99b1-0da9f9184620 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:30:53.418593 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfa2636-e0b6-47ef-99b1-0da9f9184620 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:30:53.423550 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfa2636-e0b6-47ef-99b1-0da9f9184620 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:30:53.434399 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application [None req-1bfa2636-e0b6-47ef-99b1-0da9f9184620 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:30:53.434399 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:30:53.434399 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:30:53.434399 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:30:53.434399 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:30:53.434399 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:30:53.434399 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:30:53.434399 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:30:53.434399 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:30:53.434399 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:30:53.434399 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:30:53.434399 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:30:53.434399 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 19:30:53.434399 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 19:30:53.434399 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 19:30:53.434399 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 19:30:53.435517 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:30:53.435517 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:30:53.435517 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:30:53.435517 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:30:53.435517 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:30:53.435517 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:30:53.435517 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:30:53.435517 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application with Lock( Aug 18 19:30:53.435517 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:30:53.435517 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:30:53.435517 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:30:53.435517 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:30:53.435517 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:30:53.435517 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:30:53.435517 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:30:53.435517 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:30:53.435517 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 19:30:53.436610 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 19:30:53.436610 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:30:53.436610 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:30:53.436610 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 445/872] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Aug 18 19:30:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:30:53.441401 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e022a776-35a7-4c1d-a818-233f7b61df69 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:30:53.541523 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e022a776-35a7-4c1d-a818-233f7b61df69 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:30:53.574206 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51fb600-817a-4dd1-893e-156bf45aa611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:30:53.574809 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51fb600-817a-4dd1-893e-156bf45aa611 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:30:53.575094 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51fb600-817a-4dd1-893e-156bf45aa611 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:30:53.575350 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51fb600-817a-4dd1-893e-156bf45aa611 None admin] PATH_INFO: `/v3/domains` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:30:53.576137 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51fb600-817a-4dd1-893e-156bf45aa611 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:30:53.576441 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51fb600-817a-4dd1-893e-156bf45aa611 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:30:53.577807 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51fb600-817a-4dd1-893e-156bf45aa611 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:30:53.589703 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 428/873] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Aug 18 19:30:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:30:53.595420 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfa2636-e0b6-47ef-99b1-0da9f9184620 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:30:53.695034 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfa2636-e0b6-47ef-99b1-0da9f9184620 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:30:53.720293 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:30:53.727840 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0df63d-6e83-45f3-a301-44fb1a01ceef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:30:53.728450 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0df63d-6e83-45f3-a301-44fb1a01ceef None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:30:53.729361 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0df63d-6e83-45f3-a301-44fb1a01ceef None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:30:53.729637 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0df63d-6e83-45f3-a301-44fb1a01ceef None admin] PATH_INFO: `/v3/users/placement` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:30:53.736842 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0df63d-6e83-45f3-a301-44fb1a01ceef None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:30:53.738297 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0df63d-6e83-45f3-a301-44fb1a01ceef None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:30:53.749822 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application [None req-4d0df63d-6e83-45f3-a301-44fb1a01ceef None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 18 19:30:53.749822 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:30:53.749822 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:30:53.749822 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:30:53.749822 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:30:53.749822 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:30:53.749822 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:30:53.749822 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:30:53.749822 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:30:53.749822 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:30:53.749822 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:30:53.749822 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:30:53.749822 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 19:30:53.749822 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 19:30:53.749822 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 19:30:53.749822 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 19:30:53.750929 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:30:53.750929 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:30:53.750929 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 19:30:53.750929 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 19:30:53.750929 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 19:30:53.750929 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 19:30:53.750929 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:30:53.750929 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:30:53.750929 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:30:53.750929 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:30:53.750929 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:30:53.750929 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application with Lock( Aug 18 19:30:53.750929 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:30:53.750929 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:30:53.750929 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:30:53.750929 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:30:53.750929 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:30:53.750929 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:30:53.752066 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:30:53.752066 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:30:53.752066 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 19:30:53.752066 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 19:30:53.752066 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 19:30:53.752066 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 19:30:53.752066 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 19:30:53.752066 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 19:30:53.752066 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 18 19:30:53.752066 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:30:53.752066 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 446/874] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Aug 18 19:30:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:30:53.756858 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51fb600-817a-4dd1-893e-156bf45aa611 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:30:53.805965 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:30:53.855208 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51fb600-817a-4dd1-893e-156bf45aa611 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:30:53.888142 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f27757-e363-4c50-b46a-1165de3c6ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:30:53.888779 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f27757-e363-4c50-b46a-1165de3c6ce2 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:30:53.889079 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f27757-e363-4c50-b46a-1165de3c6ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:30:53.889349 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f27757-e363-4c50-b46a-1165de3c6ce2 None admin] PATH_INFO: `/v3/users` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:30:53.890084 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f27757-e363-4c50-b46a-1165de3c6ce2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:30:53.890384 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f27757-e363-4c50-b46a-1165de3c6ce2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:30:53.891784 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f27757-e363-4c50-b46a-1165de3c6ce2 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:30:53.909489 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 429/875] 10.222.0.23 () {56 vars in 1143 bytes} [Thu Aug 18 19:30:53 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:30:53.919067 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0df63d-6e83-45f3-a301-44fb1a01ceef None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:30:54.018069 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0df63d-6e83-45f3-a301-44fb1a01ceef None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:30:54.053419 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7589c9e-f58d-4106-953e-e2d73474f99c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:30:54.054055 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7589c9e-f58d-4106-953e-e2d73474f99c None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:30:54.054446 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7589c9e-f58d-4106-953e-e2d73474f99c None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:30:54.054728 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7589c9e-f58d-4106-953e-e2d73474f99c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:30:54.111818 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:30:54.123697 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7589c9e-f58d-4106-953e-e2d73474f99c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:30:54.125147 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7589c9e-f58d-4106-953e-e2d73474f99c None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:30:54.220863 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 447/876] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Aug 18 19:30:53 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 19:30:54.226826 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f27757-e363-4c50-b46a-1165de3c6ce2 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:30:54.325271 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f27757-e363-4c50-b46a-1165de3c6ce2 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:30:54.334484 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:30:54.358692 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208f83c1-dec0-4a8c-8b91-b37c73f57cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:30:54.359311 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f83c1-dec0-4a8c-8b91-b37c73f57cd2 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:30:54.360874 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f83c1-dec0-4a8c-8b91-b37c73f57cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:30:54.360874 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f83c1-dec0-4a8c-8b91-b37c73f57cd2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:30:54.369373 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208f83c1-dec0-4a8c-8b91-b37c73f57cd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:30:54.370822 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208f83c1-dec0-4a8c-8b91-b37c73f57cd2 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:30:54.385731 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application [None req-208f83c1-dec0-4a8c-8b91-b37c73f57cd2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:30:54.385731 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:30:54.385731 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:30:54.385731 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:30:54.385731 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:30:54.385731 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:30:54.385731 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:30:54.385731 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:30:54.385731 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:30:54.385731 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:30:54.385731 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:30:54.385731 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:30:54.385731 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 19:30:54.385731 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 19:30:54.385731 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 19:30:54.385731 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 19:30:54.386803 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:30:54.386803 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:30:54.386803 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:30:54.386803 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:30:54.386803 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:30:54.386803 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:30:54.386803 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:30:54.386803 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application with Lock( Aug 18 19:30:54.386803 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:30:54.386803 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:30:54.386803 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:30:54.386803 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:30:54.386803 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:30:54.386803 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:30:54.386803 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:30:54.386803 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:30:54.386803 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 19:30:54.387902 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 19:30:54.387902 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:30:54.387902 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:30:54.387902 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 430/877] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Aug 18 19:30:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:30:54.392635 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7589c9e-f58d-4106-953e-e2d73474f99c None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:30:54.477131 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:30:54.488303 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7589c9e-f58d-4106-953e-e2d73474f99c None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:30:54.521450 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bd7c35-0524-425f-922b-5fecd0c64a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:30:54.522067 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bd7c35-0524-425f-922b-5fecd0c64a7e None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:30:54.522343 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bd7c35-0524-425f-922b-5fecd0c64a7e None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:30:54.522613 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bd7c35-0524-425f-922b-5fecd0c64a7e None admin] PATH_INFO: `/v3/domains` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:30:54.523227 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bd7c35-0524-425f-922b-5fecd0c64a7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:30:54.523522 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bd7c35-0524-425f-922b-5fecd0c64a7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:30:54.524864 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bd7c35-0524-425f-922b-5fecd0c64a7e None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:30:54.536285 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 448/878] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Aug 18 19:30:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:30:54.542176 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208f83c1-dec0-4a8c-8b91-b37c73f57cd2 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:30:54.641352 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208f83c1-dec0-4a8c-8b91-b37c73f57cd2 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:30:54.676758 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04025f94-3f79-4b5b-ab54-f9dd7b45f11a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:30:54.677386 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04025f94-3f79-4b5b-ab54-f9dd7b45f11a None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:30:54.677688 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04025f94-3f79-4b5b-ab54-f9dd7b45f11a None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:30:54.677973 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04025f94-3f79-4b5b-ab54-f9dd7b45f11a None admin] PATH_INFO: `/v3/projects/service` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:30:54.685045 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04025f94-3f79-4b5b-ab54-f9dd7b45f11a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:30:54.686504 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04025f94-3f79-4b5b-ab54-f9dd7b45f11a None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:30:54.698127 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application [None req-04025f94-3f79-4b5b-ab54-f9dd7b45f11a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 19:30:54.698127 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:30:54.698127 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:30:54.698127 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:30:54.698127 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:30:54.698127 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:30:54.698127 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:30:54.698127 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:30:54.698127 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:30:54.698127 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:30:54.698127 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:30:54.698127 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:30:54.698127 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 19:30:54.698127 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 19:30:54.698127 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 19:30:54.699160 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 19:30:54.699160 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:30:54.699160 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:30:54.699160 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:30:54.699160 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:30:54.699160 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:30:54.699160 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:30:54.699160 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:30:54.699160 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application with Lock( Aug 18 19:30:54.699160 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:30:54.699160 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:30:54.699160 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:30:54.699160 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:30:54.699160 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:30:54.699160 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:30:54.699160 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:30:54.699160 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:30:54.700247 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 19:30:54.700247 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 19:30:54.700247 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 19:30:54.700247 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 19:30:54.700247 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 19:30:54.700247 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 19:30:54.700247 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 19:30:54.700247 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:30:54.700247 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 431/879] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Aug 18 19:30:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:30:54.705482 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bd7c35-0524-425f-922b-5fecd0c64a7e None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:30:54.803879 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bd7c35-0524-425f-922b-5fecd0c64a7e None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:30:54.838314 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dfba30-95b2-4741-91d0-2cd9a965bb4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:30:54.838929 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dfba30-95b2-4741-91d0-2cd9a965bb4b None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:30:54.839198 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dfba30-95b2-4741-91d0-2cd9a965bb4b None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:30:54.840943 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dfba30-95b2-4741-91d0-2cd9a965bb4b None admin] PATH_INFO: `/v3/projects` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:30:54.840943 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dfba30-95b2-4741-91d0-2cd9a965bb4b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:30:54.840943 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dfba30-95b2-4741-91d0-2cd9a965bb4b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:30:54.841852 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dfba30-95b2-4741-91d0-2cd9a965bb4b None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:30:54.853642 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 449/880] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Aug 18 19:30:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:30:54.859746 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04025f94-3f79-4b5b-ab54-f9dd7b45f11a None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:30:54.882759 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:30:54.960468 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04025f94-3f79-4b5b-ab54-f9dd7b45f11a None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:30:54.997181 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a704114a-52d5-4961-9389-7a790b54d066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:30:54.997814 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a704114a-52d5-4961-9389-7a790b54d066 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:30:54.998132 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a704114a-52d5-4961-9389-7a790b54d066 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:30:54.998405 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a704114a-52d5-4961-9389-7a790b54d066 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:30:54.999209 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a704114a-52d5-4961-9389-7a790b54d066 None admin] RBAC: Adding query filter params (role.id=33fe6be3baf44b969c8166af5142e0c7, scope.project.id=a44b197c3aa0479092f4d77d2c791c39, user.id=b80a74afafd94acd8703fda561e1e4cd) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:30:54.999603 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a704114a-52d5-4961-9389-7a790b54d066 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:30:55.001160 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a704114a-52d5-4961-9389-7a790b54d066 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:30:55.006689 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 432/881] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Aug 18 19:30:54 2022] GET /identity/v3/role_assignments?user.id=b80a74afafd94acd8703fda561e1e4cd&scope.project.id=a44b197c3aa0479092f4d77d2c791c39&role.id=33fe6be3baf44b969c8166af5142e0c7 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:30:57.155041 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae4dfc-35b8-45b0-874b-1de700b4580c None None] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:30:57.155549 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae4dfc-35b8-45b0-874b-1de700b4580c None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:30:57.155664 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae4dfc-35b8-45b0-874b-1de700b4580c None None] PATH_INFO: `/` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:30:57.156914 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 450/882] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:30:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:30:57.162320 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd57adda-2d00-4c79-8c6d-c9293c992e1f None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:30:57.162728 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd57adda-2d00-4c79-8c6d-c9293c992e1f None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:30:57.162866 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd57adda-2d00-4c79-8c6d-c9293c992e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:30:57.180642 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-fd57adda-2d00-4c79-8c6d-c9293c992e1f None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:30:57.182367 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-fd57adda-2d00-4c79-8c6d-c9293c992e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:30:57.247724 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 433/883] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:30:57 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 19:30:57.566916 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ae4dfc-35b8-45b0-874b-1de700b4580c None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:30:57.577840 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:30:57.667739 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ae4dfc-35b8-45b0-874b-1de700b4580c None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:30:57.700656 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c399c313-705b-4400-af1f-0eb2861d2b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:30:57.701274 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c399c313-705b-4400-af1f-0eb2861d2b64 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:30:57.701576 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c399c313-705b-4400-af1f-0eb2861d2b64 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:30:57.701865 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c399c313-705b-4400-af1f-0eb2861d2b64 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:30:57.711963 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c399c313-705b-4400-af1f-0eb2861d2b64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:30:57.717151 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application [None req-c399c313-705b-4400-af1f-0eb2861d2b64 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 19:30:57.717151 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:30:57.717151 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:30:57.717151 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:30:57.717151 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:30:57.717151 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:30:57.717151 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:30:57.717151 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:30:57.717151 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:30:57.717151 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:30:57.717151 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:30:57.717151 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:30:57.717151 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:30:57.717151 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:30:57.717151 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:30:57.717151 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:30:57.718314 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:30:57.718314 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:30:57.718314 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:30:57.718314 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:30:57.718314 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:30:57.718314 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:30:57.718314 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:30:57.718314 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:30:57.718314 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:30:57.718314 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:30:57.718314 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:30:57.718314 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application with Lock( Aug 18 19:30:57.718314 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:30:57.718314 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:30:57.718314 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:30:57.718314 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:30:57.719341 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:30:57.719341 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:30:57.719341 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:30:57.719341 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:30:57.719341 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:30:57.719341 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:30:57.719341 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:30:57.719341 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:30:57.719341 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:30:57.719341 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:30:57.719341 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 19:30:57.719341 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:30:57.719341 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 451/884] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Aug 18 19:30:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:30:57.724555 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd57adda-2d00-4c79-8c6d-c9293c992e1f None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:30:57.740290 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:30:57.825741 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd57adda-2d00-4c79-8c6d-c9293c992e1f None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:30:57.860227 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e806349a-d146-4964-9fe2-31eea955a979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:30:57.860826 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806349a-d146-4964-9fe2-31eea955a979 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:30:57.861104 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806349a-d146-4964-9fe2-31eea955a979 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:30:57.861374 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806349a-d146-4964-9fe2-31eea955a979 None admin] PATH_INFO: `/v3/roles` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:30:57.862058 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e806349a-d146-4964-9fe2-31eea955a979 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:30:57.862364 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e806349a-d146-4964-9fe2-31eea955a979 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:30:57.863714 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e806349a-d146-4964-9fe2-31eea955a979 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:30:57.871523 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 434/885] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Aug 18 19:30:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:30:57.877238 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c399c313-705b-4400-af1f-0eb2861d2b64 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:30:57.942544 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:30:57.975972 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c399c313-705b-4400-af1f-0eb2861d2b64 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:30:58.008295 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db2bb27-0953-4b6a-b461-a8dc5abf8ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:30:58.008941 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db2bb27-0953-4b6a-b461-a8dc5abf8ef5 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:30:58.009217 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db2bb27-0953-4b6a-b461-a8dc5abf8ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:30:58.010024 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db2bb27-0953-4b6a-b461-a8dc5abf8ef5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:30:58.019707 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db2bb27-0953-4b6a-b461-a8dc5abf8ef5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:30:58.021133 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db2bb27-0953-4b6a-b461-a8dc5abf8ef5 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:30:58.035569 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application [None req-2db2bb27-0953-4b6a-b461-a8dc5abf8ef5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:30:58.035569 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:30:58.035569 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:30:58.035569 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:30:58.035569 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:30:58.035569 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:30:58.035569 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:30:58.035569 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:30:58.035569 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:30:58.035569 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:30:58.035569 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:30:58.035569 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:30:58.035569 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 19:30:58.035569 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 19:30:58.035569 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 19:30:58.035569 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 19:30:58.036675 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:30:58.036675 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:30:58.036675 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:30:58.036675 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:30:58.036675 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:30:58.036675 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:30:58.036675 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:30:58.036675 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application with Lock( Aug 18 19:30:58.036675 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:30:58.036675 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:30:58.036675 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:30:58.036675 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:30:58.036675 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:30:58.036675 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:30:58.036675 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:30:58.036675 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:30:58.036675 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 19:30:58.037848 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 19:30:58.037848 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:30:58.037848 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:30:58.037848 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 452/886] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Aug 18 19:30:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:30:58.042607 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e806349a-d146-4964-9fe2-31eea955a979 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:30:58.123528 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:30:58.145457 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e806349a-d146-4964-9fe2-31eea955a979 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:30:58.177216 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfefeccd-d9ef-4f50-9c7d-4e88f0252fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:30:58.177851 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfefeccd-d9ef-4f50-9c7d-4e88f0252fae None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:30:58.178127 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfefeccd-d9ef-4f50-9c7d-4e88f0252fae None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:30:58.178395 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfefeccd-d9ef-4f50-9c7d-4e88f0252fae None admin] PATH_INFO: `/v3/domains` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:30:58.179018 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfefeccd-d9ef-4f50-9c7d-4e88f0252fae None admin] RBAC: Adding query filter params (name=Default) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:30:58.179315 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfefeccd-d9ef-4f50-9c7d-4e88f0252fae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:30:58.180724 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfefeccd-d9ef-4f50-9c7d-4e88f0252fae None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:30:58.192177 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 435/887] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Aug 18 19:30:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:30:58.198709 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db2bb27-0953-4b6a-b461-a8dc5abf8ef5 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:30:58.297644 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db2bb27-0953-4b6a-b461-a8dc5abf8ef5 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:30:58.317257 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:30:58.331518 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a6608b-d6d8-4e22-8624-f194f74c2302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:30:58.332123 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a6608b-d6d8-4e22-8624-f194f74c2302 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:30:58.332401 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a6608b-d6d8-4e22-8624-f194f74c2302 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:30:58.332674 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a6608b-d6d8-4e22-8624-f194f74c2302 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:30:58.339954 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a6608b-d6d8-4e22-8624-f194f74c2302 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:30:58.341376 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a6608b-d6d8-4e22-8624-f194f74c2302 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:30:58.352222 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application [None req-71a6608b-d6d8-4e22-8624-f194f74c2302 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 18 19:30:58.352222 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:30:58.352222 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:30:58.352222 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:30:58.352222 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:30:58.352222 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:30:58.352222 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:30:58.352222 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:30:58.352222 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:30:58.352222 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:30:58.352222 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:30:58.352222 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:30:58.352222 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 19:30:58.352222 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 19:30:58.352222 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 19:30:58.352222 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 19:30:58.357181 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:30:58.357181 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:30:58.357181 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 19:30:58.357181 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 19:30:58.357181 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 19:30:58.357181 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 19:30:58.357181 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:30:58.357181 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:30:58.357181 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:30:58.357181 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:30:58.357181 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:30:58.357181 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application with Lock( Aug 18 19:30:58.357181 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:30:58.357181 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:30:58.357181 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:30:58.357181 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:30:58.357181 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:30:58.357181 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:30:58.358479 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:30:58.358479 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:30:58.358479 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 19:30:58.358479 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 19:30:58.358479 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 19:30:58.358479 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 19:30:58.358479 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 19:30:58.358479 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 19:30:58.358479 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 18 19:30:58.358479 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:30:58.358479 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 453/888] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Aug 18 19:30:58 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:30:58.359395 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfefeccd-d9ef-4f50-9c7d-4e88f0252fae None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:30:58.464244 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfefeccd-d9ef-4f50-9c7d-4e88f0252fae None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:30:58.497560 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eef3e9a-2222-436d-aad1-0471cb464670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:30:58.498187 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eef3e9a-2222-436d-aad1-0471cb464670 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:30:58.498464 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eef3e9a-2222-436d-aad1-0471cb464670 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:30:58.498754 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eef3e9a-2222-436d-aad1-0471cb464670 None admin] PATH_INFO: `/v3/users` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:30:58.499442 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eef3e9a-2222-436d-aad1-0471cb464670 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:30:58.499748 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eef3e9a-2222-436d-aad1-0471cb464670 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:30:58.501170 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eef3e9a-2222-436d-aad1-0471cb464670 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:30:58.503647 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:30:58.518338 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 436/889] 10.222.0.23 () {56 vars in 1143 bytes} [Thu Aug 18 19:30:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:30:58.524091 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a6608b-d6d8-4e22-8624-f194f74c2302 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:30:58.622572 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a6608b-d6d8-4e22-8624-f194f74c2302 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:30:58.655072 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e82f9a-47ce-4c3f-9ce0-1132efc921d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:30:58.655675 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e82f9a-47ce-4c3f-9ce0-1132efc921d3 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:30:58.655950 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e82f9a-47ce-4c3f-9ce0-1132efc921d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:30:58.656217 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e82f9a-47ce-4c3f-9ce0-1132efc921d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:30:58.666281 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e82f9a-47ce-4c3f-9ce0-1132efc921d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:30:58.667694 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e82f9a-47ce-4c3f-9ce0-1132efc921d3 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:30:58.681737 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application [None req-92e82f9a-47ce-4c3f-9ce0-1132efc921d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:30:58.681737 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:30:58.681737 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:30:58.681737 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:30:58.681737 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:30:58.681737 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:30:58.681737 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:30:58.681737 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:30:58.681737 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:30:58.681737 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:30:58.681737 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:30:58.681737 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:30:58.681737 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 19:30:58.681737 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 19:30:58.681737 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 19:30:58.681737 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 19:30:58.682871 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:30:58.682871 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:30:58.682871 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:30:58.682871 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:30:58.682871 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:30:58.682871 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:30:58.682871 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:30:58.682871 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application with Lock( Aug 18 19:30:58.682871 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:30:58.682871 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:30:58.682871 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:30:58.682871 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:30:58.682871 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:30:58.682871 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:30:58.682871 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:30:58.682871 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:30:58.682871 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 19:30:58.683835 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 19:30:58.683835 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:30:58.683835 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:30:58.683835 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 454/890] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Aug 18 19:30:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:30:58.688773 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eef3e9a-2222-436d-aad1-0471cb464670 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:30:58.787131 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eef3e9a-2222-436d-aad1-0471cb464670 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:30:58.821243 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775d68d8-594e-4904-a4f2-fdc67948524c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:30:58.821900 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d68d8-594e-4904-a4f2-fdc67948524c None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:30:58.822184 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d68d8-594e-4904-a4f2-fdc67948524c None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:30:58.822459 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d68d8-594e-4904-a4f2-fdc67948524c None admin] PATH_INFO: `/v3/domains` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:30:58.823092 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775d68d8-594e-4904-a4f2-fdc67948524c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:30:58.823398 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775d68d8-594e-4904-a4f2-fdc67948524c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:30:58.824751 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775d68d8-594e-4904-a4f2-fdc67948524c None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:30:58.836129 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 437/891] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Aug 18 19:30:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:30:58.841985 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e82f9a-47ce-4c3f-9ce0-1132efc921d3 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:30:58.873831 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:30:58.939684 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e82f9a-47ce-4c3f-9ce0-1132efc921d3 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:30:58.974198 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed118e87-da99-490b-bf1d-b99af74cd2ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:30:58.974851 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed118e87-da99-490b-bf1d-b99af74cd2ab None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:30:58.975128 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed118e87-da99-490b-bf1d-b99af74cd2ab None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:30:58.975396 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed118e87-da99-490b-bf1d-b99af74cd2ab None admin] PATH_INFO: `/v3/projects/service` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:30:58.982514 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed118e87-da99-490b-bf1d-b99af74cd2ab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:30:58.983944 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed118e87-da99-490b-bf1d-b99af74cd2ab None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:30:58.995133 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application [None req-ed118e87-da99-490b-bf1d-b99af74cd2ab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 19:30:58.995133 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:30:58.995133 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:30:58.995133 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:30:58.995133 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:30:58.995133 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:30:58.995133 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:30:58.995133 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:30:58.995133 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:30:58.995133 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:30:58.995133 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:30:58.995133 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:30:58.995133 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 19:30:58.995133 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 19:30:58.995133 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 19:30:58.996162 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 19:30:58.996162 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:30:58.996162 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:30:58.996162 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:30:58.996162 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:30:58.996162 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:30:58.996162 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:30:58.996162 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:30:58.996162 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application with Lock( Aug 18 19:30:58.996162 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:30:58.996162 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:30:58.996162 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:30:58.996162 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:30:58.996162 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:30:58.996162 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:30:58.996162 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:30:58.996162 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:30:58.997288 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 19:30:58.997288 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 19:30:58.997288 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 19:30:58.997288 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 19:30:58.997288 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 19:30:58.997288 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 19:30:58.997288 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 19:30:58.997288 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:30:58.997288 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 455/892] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Aug 18 19:30:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:30:59.002180 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775d68d8-594e-4904-a4f2-fdc67948524c None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:30:59.059633 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:30:59.105464 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775d68d8-594e-4904-a4f2-fdc67948524c None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:30:59.138447 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953cf911-c05e-499d-8b79-b72dbf6119cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:30:59.139045 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953cf911-c05e-499d-8b79-b72dbf6119cb None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:30:59.139320 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953cf911-c05e-499d-8b79-b72dbf6119cb None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:30:59.139587 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953cf911-c05e-499d-8b79-b72dbf6119cb None admin] PATH_INFO: `/v3/projects` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:30:59.140255 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953cf911-c05e-499d-8b79-b72dbf6119cb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:30:59.140556 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953cf911-c05e-499d-8b79-b72dbf6119cb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:30:59.141982 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953cf911-c05e-499d-8b79-b72dbf6119cb None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:30:59.154190 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 438/893] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Aug 18 19:30:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:30:59.160230 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed118e87-da99-490b-bf1d-b99af74cd2ab None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:30:59.250582 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:30:59.258868 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed118e87-da99-490b-bf1d-b99af74cd2ab None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:30:59.292550 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188ab0d7-7621-4c19-b3ae-86e0b9700a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:30:59.293200 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ab0d7-7621-4c19-b3ae-86e0b9700a56 None admin] REQUEST_METHOD: `PUT` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:30:59.293481 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ab0d7-7621-4c19-b3ae-86e0b9700a56 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:30:59.293788 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ab0d7-7621-4c19-b3ae-86e0b9700a56 None admin] PATH_INFO: `/v3/projects/a44b197c3aa0479092f4d77d2c791c39/users/b80a74afafd94acd8703fda561e1e4cd/roles/33fe6be3baf44b969c8166af5142e0c7` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:30:59.295786 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188ab0d7-7621-4c19-b3ae-86e0b9700a56 None admin] RBAC: Authorizing `identity:create_grant(project_id=a44b197c3aa0479092f4d77d2c791c39, user_id=b80a74afafd94acd8703fda561e1e4cd, role_id=33fe6be3baf44b969c8166af5142e0c7)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:30:59.297248 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188ab0d7-7621-4c19-b3ae-86e0b9700a56 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:30:59.369786 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 456/894] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Aug 18 19:30:59 2022] PUT /identity/v3/projects/a44b197c3aa0479092f4d77d2c791c39/users/b80a74afafd94acd8703fda561e1e4cd/roles/33fe6be3baf44b969c8166af5142e0c7 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 19:31:01.540364 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa151a1-5689-482d-947b-410a5ff800ac None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:31:01.540914 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa151a1-5689-482d-947b-410a5ff800ac None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:31:01.540914 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa151a1-5689-482d-947b-410a5ff800ac None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:31:01.542164 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 439/895] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:31:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 19:31:01.547969 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec00188e-17f7-4f2a-a591-a6e29325328b None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:31:01.548475 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec00188e-17f7-4f2a-a591-a6e29325328b None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:31:01.548600 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec00188e-17f7-4f2a-a591-a6e29325328b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:31:01.569250 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-ec00188e-17f7-4f2a-a591-a6e29325328b None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:31:01.570730 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-ec00188e-17f7-4f2a-a591-a6e29325328b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:31:01.646732 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 457/896] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:31:01 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 19:31:01.976075 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa151a1-5689-482d-947b-410a5ff800ac None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:31:02.077827 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa151a1-5689-482d-947b-410a5ff800ac None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:31:02.092549 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:31:02.112330 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a791636-be5e-4e6e-8121-3d4ebe318748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:31:02.112949 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a791636-be5e-4e6e-8121-3d4ebe318748 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:31:02.113227 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a791636-be5e-4e6e-8121-3d4ebe318748 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:31:02.113498 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a791636-be5e-4e6e-8121-3d4ebe318748 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:31:02.123242 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a791636-be5e-4e6e-8121-3d4ebe318748 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 19:31:02.128561 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application [None req-1a791636-be5e-4e6e-8121-3d4ebe318748 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 19:31:02.128561 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:31:02.128561 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:31:02.128561 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:31:02.128561 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:31:02.128561 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:31:02.128561 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:31:02.128561 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:31:02.128561 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:31:02.128561 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:31:02.128561 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:31:02.128561 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:31:02.128561 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 19:31:02.128561 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 19:31:02.128561 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 19:31:02.128561 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 19:31:02.129677 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 19:31:02.129677 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 19:31:02.129677 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 19:31:02.129677 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 19:31:02.129677 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:31:02.129677 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:31:02.129677 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:31:02.129677 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:31:02.129677 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:31:02.129677 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:31:02.129677 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:31:02.129677 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application with Lock( Aug 18 19:31:02.129677 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:31:02.129677 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:31:02.129677 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:31:02.129677 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:31:02.130519 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:31:02.130519 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:31:02.130519 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:31:02.130519 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:31:02.130519 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 19:31:02.130519 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 19:31:02.130519 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 19:31:02.130519 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 19:31:02.130519 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 19:31:02.130519 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 19:31:02.130519 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 19:31:02.130519 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:31:02.130519 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 440/897] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Aug 18 19:31:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:31:02.135796 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec00188e-17f7-4f2a-a591-a6e29325328b None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:31:02.216185 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:31:02.233810 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec00188e-17f7-4f2a-a591-a6e29325328b None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:31:02.265519 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fc0fbb-a658-41d7-8142-22ec2eaab9a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:31:02.266153 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fc0fbb-a658-41d7-8142-22ec2eaab9a9 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:31:02.266436 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fc0fbb-a658-41d7-8142-22ec2eaab9a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:31:02.266709 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fc0fbb-a658-41d7-8142-22ec2eaab9a9 None admin] PATH_INFO: `/v3/roles` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:31:02.267362 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fc0fbb-a658-41d7-8142-22ec2eaab9a9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:31:02.267663 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fc0fbb-a658-41d7-8142-22ec2eaab9a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:31:02.269016 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fc0fbb-a658-41d7-8142-22ec2eaab9a9 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:31:02.277179 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 458/898] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Aug 18 19:31:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:31:02.283080 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a791636-be5e-4e6e-8121-3d4ebe318748 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:31:02.383472 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a791636-be5e-4e6e-8121-3d4ebe318748 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:31:02.417796 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6f92cd-4413-499a-9713-77d9161888c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:31:02.418408 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f92cd-4413-499a-9713-77d9161888c5 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:31:02.418687 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f92cd-4413-499a-9713-77d9161888c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:31:02.418957 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f92cd-4413-499a-9713-77d9161888c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:31:02.428616 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6f92cd-4413-499a-9713-77d9161888c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:31:02.430099 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6f92cd-4413-499a-9713-77d9161888c5 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:31:02.444207 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application [None req-3e6f92cd-4413-499a-9713-77d9161888c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:31:02.444207 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:31:02.444207 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:31:02.444207 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:31:02.444207 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:31:02.444207 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:31:02.444207 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:31:02.444207 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:31:02.444207 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:31:02.444207 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:31:02.444207 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:31:02.444207 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:31:02.444207 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 19:31:02.444207 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 19:31:02.444207 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 19:31:02.444207 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 19:31:02.445322 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:31:02.445322 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:31:02.445322 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:31:02.445322 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:31:02.445322 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:31:02.445322 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:31:02.445322 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:31:02.445322 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application with Lock( Aug 18 19:31:02.445322 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:31:02.445322 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:31:02.445322 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:31:02.445322 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:31:02.445322 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:31:02.445322 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:31:02.445322 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:31:02.445322 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:31:02.445322 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 19:31:02.446435 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 19:31:02.446435 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:31:02.446435 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:31:02.446435 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 441/899] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Aug 18 19:31:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:31:02.451549 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fc0fbb-a658-41d7-8142-22ec2eaab9a9 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:31:02.550179 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fc0fbb-a658-41d7-8142-22ec2eaab9a9 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:31:02.583115 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d053cd2-7cb5-4d2c-b3a7-80d8b76ac6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:31:02.583707 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d053cd2-7cb5-4d2c-b3a7-80d8b76ac6d4 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:31:02.583983 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d053cd2-7cb5-4d2c-b3a7-80d8b76ac6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:31:02.584253 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d053cd2-7cb5-4d2c-b3a7-80d8b76ac6d4 None admin] PATH_INFO: `/v3/domains` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:31:02.584877 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d053cd2-7cb5-4d2c-b3a7-80d8b76ac6d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:31:02.585191 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d053cd2-7cb5-4d2c-b3a7-80d8b76ac6d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:31:02.586574 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d053cd2-7cb5-4d2c-b3a7-80d8b76ac6d4 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:31:02.598705 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 459/900] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Aug 18 19:31:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:31:02.604396 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6f92cd-4413-499a-9713-77d9161888c5 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:31:02.631709 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:31:02.702276 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6f92cd-4413-499a-9713-77d9161888c5 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:31:02.735146 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3727e883-2cf3-4a8d-a010-96c4831f9a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:31:02.735761 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3727e883-2cf3-4a8d-a010-96c4831f9a13 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:31:02.736041 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3727e883-2cf3-4a8d-a010-96c4831f9a13 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:31:02.736313 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3727e883-2cf3-4a8d-a010-96c4831f9a13 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:31:02.743523 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3727e883-2cf3-4a8d-a010-96c4831f9a13 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:31:02.744949 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3727e883-2cf3-4a8d-a010-96c4831f9a13 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:31:02.755634 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application [None req-3727e883-2cf3-4a8d-a010-96c4831f9a13 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 18 19:31:02.755634 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:31:02.755634 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:31:02.755634 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:31:02.755634 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:31:02.755634 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:31:02.755634 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:31:02.755634 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:31:02.755634 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:31:02.755634 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:31:02.755634 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:31:02.755634 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:31:02.755634 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 19:31:02.755634 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 19:31:02.755634 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 19:31:02.755634 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 19:31:02.756754 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:31:02.756754 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:31:02.756754 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 19:31:02.756754 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 19:31:02.756754 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 19:31:02.756754 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 19:31:02.756754 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:31:02.756754 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:31:02.756754 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:31:02.756754 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:31:02.756754 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:31:02.756754 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application with Lock( Aug 18 19:31:02.756754 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:31:02.756754 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:31:02.756754 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:31:02.756754 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:31:02.756754 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:31:02.756754 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:31:02.758077 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:31:02.758077 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:31:02.758077 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 19:31:02.758077 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 19:31:02.758077 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 19:31:02.758077 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 19:31:02.758077 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 19:31:02.758077 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 19:31:02.758077 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 18 19:31:02.758077 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:31:02.758077 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 442/901] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Aug 18 19:31:02 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:31:02.763011 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d053cd2-7cb5-4d2c-b3a7-80d8b76ac6d4 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:31:02.766687 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:31:02.859643 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d053cd2-7cb5-4d2c-b3a7-80d8b76ac6d4 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:31:02.893083 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6c7635-ddea-4101-ab13-e7a672360295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:31:02.893821 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6c7635-ddea-4101-ab13-e7a672360295 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:31:02.894072 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6c7635-ddea-4101-ab13-e7a672360295 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:31:02.894341 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6c7635-ddea-4101-ab13-e7a672360295 None admin] PATH_INFO: `/v3/users` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:31:02.895045 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6c7635-ddea-4101-ab13-e7a672360295 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:31:02.895344 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6c7635-ddea-4101-ab13-e7a672360295 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:31:02.896755 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6c7635-ddea-4101-ab13-e7a672360295 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:31:02.913257 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 460/902] 10.222.0.23 () {56 vars in 1143 bytes} [Thu Aug 18 19:31:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:31:02.919144 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3727e883-2cf3-4a8d-a010-96c4831f9a13 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:31:03.004986 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:31:03.020296 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3727e883-2cf3-4a8d-a010-96c4831f9a13 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:31:03.052137 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84130e33-0e27-4eec-8711-7a61b834b528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:31:03.052799 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84130e33-0e27-4eec-8711-7a61b834b528 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:31:03.053023 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84130e33-0e27-4eec-8711-7a61b834b528 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:31:03.053297 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84130e33-0e27-4eec-8711-7a61b834b528 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:31:03.121168 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84130e33-0e27-4eec-8711-7a61b834b528 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:31:03.122597 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84130e33-0e27-4eec-8711-7a61b834b528 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:31:03.203295 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:31:03.219085 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 443/903] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Aug 18 19:31:02 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 19:31:03.224919 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6c7635-ddea-4101-ab13-e7a672360295 None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:31:03.283843 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:31:03.320597 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6c7635-ddea-4101-ab13-e7a672360295 None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:31:03.353409 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d30f649-ec77-44cc-a8e5-c02b9b33244b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:31:03.354065 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d30f649-ec77-44cc-a8e5-c02b9b33244b None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:31:03.354343 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d30f649-ec77-44cc-a8e5-c02b9b33244b None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:31:03.354614 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d30f649-ec77-44cc-a8e5-c02b9b33244b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:31:03.365635 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d30f649-ec77-44cc-a8e5-c02b9b33244b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:31:03.367089 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d30f649-ec77-44cc-a8e5-c02b9b33244b None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:31:03.381036 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application [None req-6d30f649-ec77-44cc-a8e5-c02b9b33244b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:31:03.381036 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:31:03.381036 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:31:03.381036 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:31:03.381036 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:31:03.381036 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:31:03.381036 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:31:03.381036 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:31:03.381036 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:31:03.381036 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:31:03.381036 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:31:03.381036 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:31:03.381036 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 19:31:03.381036 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 19:31:03.381036 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 19:31:03.381036 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 19:31:03.382194 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:31:03.382194 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:31:03.382194 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:31:03.382194 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:31:03.382194 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:31:03.382194 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:31:03.382194 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:31:03.382194 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application with Lock( Aug 18 19:31:03.382194 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:31:03.382194 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:31:03.382194 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:31:03.382194 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:31:03.382194 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:31:03.382194 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:31:03.382194 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:31:03.382194 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:31:03.382194 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 19:31:03.383071 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 19:31:03.383071 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 19:31:03.383071 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:31:03.383071 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 461/904] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Aug 18 19:31:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:31:03.387878 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84130e33-0e27-4eec-8711-7a61b834b528 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:31:03.483822 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84130e33-0e27-4eec-8711-7a61b834b528 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:31:03.516655 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a890c6d-dc35-4715-8906-099fde783fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:31:03.517274 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a890c6d-dc35-4715-8906-099fde783fd0 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:31:03.517550 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a890c6d-dc35-4715-8906-099fde783fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:31:03.517849 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a890c6d-dc35-4715-8906-099fde783fd0 None admin] PATH_INFO: `/v3/domains` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:31:03.518471 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a890c6d-dc35-4715-8906-099fde783fd0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:31:03.518772 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a890c6d-dc35-4715-8906-099fde783fd0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:31:03.520115 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a890c6d-dc35-4715-8906-099fde783fd0 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:31:03.530952 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 444/905] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Aug 18 19:31:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:31:03.536666 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d30f649-ec77-44cc-a8e5-c02b9b33244b None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:31:03.636531 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d30f649-ec77-44cc-a8e5-c02b9b33244b None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:31:03.650249 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:31:03.670124 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adae5103-ff99-4772-a65e-ac45be2202ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:31:03.670770 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae5103-ff99-4772-a65e-ac45be2202ae None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:31:03.671089 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae5103-ff99-4772-a65e-ac45be2202ae None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:31:03.671321 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae5103-ff99-4772-a65e-ac45be2202ae None admin] PATH_INFO: `/v3/projects/service` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:31:03.677807 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adae5103-ff99-4772-a65e-ac45be2202ae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:31:03.679233 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adae5103-ff99-4772-a65e-ac45be2202ae None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:31:03.690322 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application [None req-adae5103-ff99-4772-a65e-ac45be2202ae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 19:31:03.690322 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:31:03.690322 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:31:03.690322 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:31:03.690322 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:31:03.690322 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:31:03.690322 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:31:03.690322 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:31:03.690322 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:31:03.690322 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:31:03.690322 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:31:03.690322 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:31:03.690322 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 19:31:03.690322 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 19:31:03.690322 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 19:31:03.691341 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 19:31:03.691341 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:31:03.691341 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:31:03.691341 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:31:03.691341 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:31:03.691341 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:31:03.691341 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:31:03.691341 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:31:03.691341 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application with Lock( Aug 18 19:31:03.691341 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:31:03.691341 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:31:03.691341 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:31:03.691341 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:31:03.691341 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:31:03.691341 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:31:03.691341 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:31:03.691341 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:31:03.692225 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 19:31:03.692225 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 19:31:03.692225 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 19:31:03.692225 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 19:31:03.692225 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 19:31:03.692225 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 19:31:03.692225 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 19:31:03.692225 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: ERROR keystone.server.flask.application Aug 18 19:31:03.692225 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 462/906] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Aug 18 19:31:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:31:03.698994 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a890c6d-dc35-4715-8906-099fde783fd0 None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:31:03.746791 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:31:03.798567 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a890c6d-dc35-4715-8906-099fde783fd0 None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:31:03.830731 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1a940b-d78e-4f43-9b10-18a64f5fe12a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:31:03.831372 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1a940b-d78e-4f43-9b10-18a64f5fe12a None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:31:03.831652 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1a940b-d78e-4f43-9b10-18a64f5fe12a None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:31:03.831922 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1a940b-d78e-4f43-9b10-18a64f5fe12a None admin] PATH_INFO: `/v3/projects` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:31:03.832600 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1a940b-d78e-4f43-9b10-18a64f5fe12a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:31:03.832903 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1a940b-d78e-4f43-9b10-18a64f5fe12a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:31:03.834349 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1a940b-d78e-4f43-9b10-18a64f5fe12a None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:31:03.846757 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 445/907] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Aug 18 19:31:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:31:03.853444 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adae5103-ff99-4772-a65e-ac45be2202ae None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:31:03.951322 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adae5103-ff99-4772-a65e-ac45be2202ae None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:31:03.984512 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd341db-82d3-417a-82fd-397845aae69e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:31:03.985144 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd341db-82d3-417a-82fd-397845aae69e None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:31:03.985424 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd341db-82d3-417a-82fd-397845aae69e None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:31:03.985719 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd341db-82d3-417a-82fd-397845aae69e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:31:03.986441 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd341db-82d3-417a-82fd-397845aae69e None admin] RBAC: Adding query filter params (role.id=33fe6be3baf44b969c8166af5142e0c7, scope.project.id=a44b197c3aa0479092f4d77d2c791c39, user.id=b80a74afafd94acd8703fda561e1e4cd) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:31:03.986749 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd341db-82d3-417a-82fd-397845aae69e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:31:03.988163 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd341db-82d3-417a-82fd-397845aae69e None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:31:03.993947 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 463/908] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Aug 18 19:31:03 2022] GET /identity/v3/role_assignments?user.id=b80a74afafd94acd8703fda561e1e4cd&scope.project.id=a44b197c3aa0479092f4d77d2c791c39&role.id=33fe6be3baf44b969c8166af5142e0c7 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:31:06.205400 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20ea716-b776-41ca-9c76-eaed946f963d None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:31:06.206007 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20ea716-b776-41ca-9c76-eaed946f963d None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:31:06.206007 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20ea716-b776-41ca-9c76-eaed946f963d None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:31:06.207305 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 446/909] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:31:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 19:31:06.212476 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75678a7-04f5-43fc-b664-ade0e7980dcf None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:31:06.212874 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75678a7-04f5-43fc-b664-ade0e7980dcf None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:31:06.213013 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75678a7-04f5-43fc-b664-ade0e7980dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:31:06.231487 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-b75678a7-04f5-43fc-b664-ade0e7980dcf None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:31:06.232656 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-b75678a7-04f5-43fc-b664-ade0e7980dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:31:06.262521 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:31:06.298470 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 464/910] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:31:06 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 19:31:06.622268 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20ea716-b776-41ca-9c76-eaed946f963d None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:31:06.721966 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20ea716-b776-41ca-9c76-eaed946f963d None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:31:06.729266 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:31:06.755130 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9583c5bb-2ec2-4407-91b7-4ea611dfeaaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:31:06.756500 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9583c5bb-2ec2-4407-91b7-4ea611dfeaaa None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:31:06.756500 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9583c5bb-2ec2-4407-91b7-4ea611dfeaaa None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:31:06.756500 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9583c5bb-2ec2-4407-91b7-4ea611dfeaaa None admin] PATH_INFO: `/v3/services/placement` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:31:06.756889 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9583c5bb-2ec2-4407-91b7-4ea611dfeaaa None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:31:06.758269 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9583c5bb-2ec2-4407-91b7-4ea611dfeaaa None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:31:06.767224 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application [None req-9583c5bb-2ec2-4407-91b7-4ea611dfeaaa None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 19:31:06.767224 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:31:06.767224 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 19:31:06.767224 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 19:31:06.767224 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 19:31:06.767224 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 19:31:06.767224 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 19:31:06.767224 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 19:31:06.767224 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 19:31:06.767224 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:31:06.767224 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 19:31:06.767224 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:31:06.767224 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:31:06.767224 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:31:06.767224 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:31:06.767224 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:31:06.767224 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:31:06.768576 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:31:06.768576 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:31:06.768576 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:31:06.768576 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:31:06.768576 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:31:06.768576 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:31:06.768576 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 19:31:06.768576 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 19:31:06.768576 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 19:31:06.768576 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 19:31:06.768576 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:31:06.768576 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:31:06.768576 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:31:06.768576 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:31:06.768576 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:31:06.768576 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:31:06.769778 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:31:06.769778 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application with Lock( Aug 18 19:31:06.769778 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:31:06.769778 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:31:06.769778 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:31:06.769778 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:31:06.769778 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:31:06.769778 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:31:06.769778 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:31:06.769778 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:31:06.769778 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 19:31:06.769778 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 19:31:06.769778 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 19:31:06.769778 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:31:06.769778 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 447/911] 10.222.0.23 () {56 vars in 1117 bytes} [Thu Aug 18 19:31:06 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:31:06.774459 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75678a7-04f5-43fc-b664-ade0e7980dcf None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:31:06.871398 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75678a7-04f5-43fc-b664-ade0e7980dcf None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:31:06.904192 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fecd29-f0b5-4c69-92df-39d0d04a62c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:31:06.904792 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fecd29-f0b5-4c69-92df-39d0d04a62c3 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:31:06.905065 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fecd29-f0b5-4c69-92df-39d0d04a62c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:31:06.905331 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fecd29-f0b5-4c69-92df-39d0d04a62c3 None admin] PATH_INFO: `/v3/services` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:31:06.905974 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fecd29-f0b5-4c69-92df-39d0d04a62c3 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:31:06.909933 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fecd29-f0b5-4c69-92df-39d0d04a62c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:31:06.909933 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fecd29-f0b5-4c69-92df-39d0d04a62c3 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:31:06.912140 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 465/912] 10.222.0.23 () {56 vars in 1116 bytes} [Thu Aug 18 19:31:06 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:31:06.917952 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9583c5bb-2ec2-4407-91b7-4ea611dfeaaa None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:31:07.015353 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9583c5bb-2ec2-4407-91b7-4ea611dfeaaa None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:31:07.047696 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafc78e8-592e-41bf-9a74-57df5027058c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:31:07.048301 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafc78e8-592e-41bf-9a74-57df5027058c None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:31:07.048571 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafc78e8-592e-41bf-9a74-57df5027058c None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:31:07.048841 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafc78e8-592e-41bf-9a74-57df5027058c None admin] PATH_INFO: `/v3/services` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:31:07.049457 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafc78e8-592e-41bf-9a74-57df5027058c None admin] RBAC: Adding query filter params (type=placement) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:31:07.049791 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafc78e8-592e-41bf-9a74-57df5027058c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:31:07.051134 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafc78e8-592e-41bf-9a74-57df5027058c None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:31:07.055391 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 448/913] 10.222.0.23 () {56 vars in 1116 bytes} [Thu Aug 18 19:31:06 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:31:09.196583 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0b6cdd-4940-4e47-872c-bb30cd6ce9b8 None None] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:31:09.197134 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0b6cdd-4940-4e47-872c-bb30cd6ce9b8 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:31:09.197134 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0b6cdd-4940-4e47-872c-bb30cd6ce9b8 None None] PATH_INFO: `/` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:31:09.198480 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 466/914] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:31:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:31:09.203918 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf61fad-2a3e-4a44-b309-432ed9c071ac None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:31:09.205736 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf61fad-2a3e-4a44-b309-432ed9c071ac None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:31:09.205736 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf61fad-2a3e-4a44-b309-432ed9c071ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:31:09.222391 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-bdf61fad-2a3e-4a44-b309-432ed9c071ac None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:31:09.223559 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-bdf61fad-2a3e-4a44-b309-432ed9c071ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:31:09.250707 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:31:09.290484 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 449/915] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:31:09 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 19:31:09.618825 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0b6cdd-4940-4e47-872c-bb30cd6ce9b8 None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:31:09.649556 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:31:09.717889 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0b6cdd-4940-4e47-872c-bb30cd6ce9b8 None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:31:09.751151 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5c1c2d-4f97-4703-825d-654ffb58ca0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:31:09.751735 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c1c2d-4f97-4703-825d-654ffb58ca0d None admin] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:31:09.752010 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c1c2d-4f97-4703-825d-654ffb58ca0d None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:31:09.752279 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c1c2d-4f97-4703-825d-654ffb58ca0d None admin] PATH_INFO: `/v3/services` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:31:09.752910 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5c1c2d-4f97-4703-825d-654ffb58ca0d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:31:09.754290 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5c1c2d-4f97-4703-825d-654ffb58ca0d None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:31:09.820141 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 467/916] 10.222.0.23 () {60 vars in 1141 bytes} [Thu Aug 18 19:31:09 2022] POST /identity/v3/services => generated 246 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 19:31:12.021738 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad2a85d-88e6-4499-96ee-fcfd71f20669 None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:31:12.022323 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad2a85d-88e6-4499-96ee-fcfd71f20669 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:31:12.022323 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad2a85d-88e6-4499-96ee-fcfd71f20669 None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:31:12.023689 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 450/917] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:31:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:31:12.028791 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0530c-5a4a-4c2a-bacc-f7347af1dbd9 None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:31:12.029210 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0530c-5a4a-4c2a-bacc-f7347af1dbd9 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:31:12.029314 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0530c-5a4a-4c2a-bacc-f7347af1dbd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:31:12.047683 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-b4d0530c-5a4a-4c2a-bacc-f7347af1dbd9 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:31:12.048866 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-b4d0530c-5a4a-4c2a-bacc-f7347af1dbd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:31:12.121451 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 468/918] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:31:12 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 19:31:12.456419 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad2a85d-88e6-4499-96ee-fcfd71f20669 None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:31:12.555934 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad2a85d-88e6-4499-96ee-fcfd71f20669 None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:31:12.589108 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaf82bd-d9de-4266-b29f-f8a8b9eef32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:31:12.589755 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf82bd-d9de-4266-b29f-f8a8b9eef32a None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:31:12.590039 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf82bd-d9de-4266-b29f-f8a8b9eef32a None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:31:12.590313 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf82bd-d9de-4266-b29f-f8a8b9eef32a None admin] PATH_INFO: `/v3/services/placement` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:31:12.590889 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaf82bd-d9de-4266-b29f-f8a8b9eef32a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:31:12.592248 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaf82bd-d9de-4266-b29f-f8a8b9eef32a None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:31:12.600698 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application [None req-0eaf82bd-d9de-4266-b29f-f8a8b9eef32a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 19:31:12.600698 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:31:12.600698 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 19:31:12.600698 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 19:31:12.600698 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 19:31:12.600698 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 19:31:12.600698 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 19:31:12.600698 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 19:31:12.600698 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 19:31:12.600698 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:31:12.600698 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 19:31:12.600698 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:31:12.600698 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:31:12.600698 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:31:12.600698 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:31:12.600698 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:31:12.600698 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:31:12.606217 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:31:12.606217 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:31:12.606217 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:31:12.606217 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:31:12.606217 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:31:12.606217 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:31:12.606217 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 19:31:12.606217 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 19:31:12.606217 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 19:31:12.606217 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 19:31:12.606217 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:31:12.606217 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:31:12.606217 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:31:12.606217 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:31:12.606217 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:31:12.606217 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:31:12.607334 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:31:12.607334 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application with Lock( Aug 18 19:31:12.607334 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:31:12.607334 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:31:12.607334 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:31:12.607334 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:31:12.607334 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:31:12.607334 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:31:12.607334 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:31:12.607334 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:31:12.607334 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 19:31:12.607334 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 19:31:12.607334 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 19:31:12.607334 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:31:12.607334 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 451/919] 10.222.0.23 () {56 vars in 1117 bytes} [Thu Aug 18 19:31:12 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:31:12.608471 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d0530c-5a4a-4c2a-bacc-f7347af1dbd9 None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:31:12.626859 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:31:12.703722 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d0530c-5a4a-4c2a-bacc-f7347af1dbd9 None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:31:12.737512 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f6f540-8405-4e0c-b859-251dfbbfa9da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:31:12.738074 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f6f540-8405-4e0c-b859-251dfbbfa9da None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:31:12.738350 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f6f540-8405-4e0c-b859-251dfbbfa9da None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:31:12.738617 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f6f540-8405-4e0c-b859-251dfbbfa9da None admin] PATH_INFO: `/v3/services` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:31:12.739250 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f6f540-8405-4e0c-b859-251dfbbfa9da None admin] RBAC: Adding query filter params (name=placement) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:31:12.739547 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f6f540-8405-4e0c-b859-251dfbbfa9da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:31:12.740899 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f6f540-8405-4e0c-b859-251dfbbfa9da None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:31:12.745786 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 469/920] 10.222.0.23 () {56 vars in 1116 bytes} [Thu Aug 18 19:31:12 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:31:12.751741 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaf82bd-d9de-4266-b29f-f8a8b9eef32a None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:31:12.780118 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:31:12.851501 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaf82bd-d9de-4266-b29f-f8a8b9eef32a None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:31:12.884809 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f5ea63-60e8-4d72-8bf1-fb9488ce5743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:31:12.885403 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5ea63-60e8-4d72-8bf1-fb9488ce5743 None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:31:12.885698 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5ea63-60e8-4d72-8bf1-fb9488ce5743 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:31:12.885970 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5ea63-60e8-4d72-8bf1-fb9488ce5743 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:31:12.886652 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f5ea63-60e8-4d72-8bf1-fb9488ce5743 None admin] RBAC: Adding query filter params (interface=public, service_id=deaec32b72914469aa2a0416aad800a7, region_id=RegionOne) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:31:12.886964 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f5ea63-60e8-4d72-8bf1-fb9488ce5743 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:31:12.888301 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f5ea63-60e8-4d72-8bf1-fb9488ce5743 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:31:12.893443 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 452/921] 10.222.0.23 () {56 vars in 1251 bytes} [Thu Aug 18 19:31:12 2022] GET /identity/v3/endpoints?service_id=deaec32b72914469aa2a0416aad800a7&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:31:12.900347 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f6f540-8405-4e0c-b859-251dfbbfa9da None admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:31:12.980647 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:31:12.997910 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f6f540-8405-4e0c-b859-251dfbbfa9da None admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:31:13.031970 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac5b98b-571b-4553-b04f-102fb5716490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:31:13.032571 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac5b98b-571b-4553-b04f-102fb5716490 None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:31:13.032849 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac5b98b-571b-4553-b04f-102fb5716490 None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:31:13.033118 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac5b98b-571b-4553-b04f-102fb5716490 None admin] PATH_INFO: `/v3/services` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:31:13.033748 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac5b98b-571b-4553-b04f-102fb5716490 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:31:13.035119 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac5b98b-571b-4553-b04f-102fb5716490 None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:31:13.041584 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 470/922] 10.222.0.23 () {56 vars in 1087 bytes} [Thu Aug 18 19:31:12 2022] GET /identity/v3/services => generated 1962 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 19:31:15.202901 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91d6d1e-fca7-4690-8817-82f08b3a7744 None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:31:15.203410 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91d6d1e-fca7-4690-8817-82f08b3a7744 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:31:15.203499 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91d6d1e-fca7-4690-8817-82f08b3a7744 None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:31:15.205025 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 453/923] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:31:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:31:15.210376 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca38634-a60f-4af9-8fca-89c6550a643e None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:31:15.210792 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca38634-a60f-4af9-8fca-89c6550a643e None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:31:15.210898 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca38634-a60f-4af9-8fca-89c6550a643e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:31:15.229514 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-6ca38634-a60f-4af9-8fca-89c6550a643e None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:31:15.230766 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-6ca38634-a60f-4af9-8fca-89c6550a643e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:31:15.295782 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 471/924] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:31:15 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 19:31:15.623557 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91d6d1e-fca7-4690-8817-82f08b3a7744 None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:31:15.716440 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:31:15.725819 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91d6d1e-fca7-4690-8817-82f08b3a7744 None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:31:15.758521 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce51314-0692-4b80-a56d-f5ee973e54df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:31:15.759141 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce51314-0692-4b80-a56d-f5ee973e54df None admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:31:15.759443 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce51314-0692-4b80-a56d-f5ee973e54df None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:31:15.759712 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce51314-0692-4b80-a56d-f5ee973e54df None admin] PATH_INFO: `/v3/services/placement` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:31:15.760278 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce51314-0692-4b80-a56d-f5ee973e54df None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:31:15.761628 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce51314-0692-4b80-a56d-f5ee973e54df None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:31:15.769925 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application [None req-2ce51314-0692-4b80-a56d-f5ee973e54df None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 19:31:15.769925 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:31:15.769925 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 19:31:15.769925 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 19:31:15.769925 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 19:31:15.769925 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 19:31:15.769925 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 19:31:15.769925 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 19:31:15.769925 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 19:31:15.769925 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:31:15.769925 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 19:31:15.769925 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:31:15.769925 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 19:31:15.769925 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 19:31:15.769925 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 19:31:15.769925 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 19:31:15.769925 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 19:31:15.771089 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 19:31:15.771089 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 19:31:15.771089 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 19:31:15.771089 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 19:31:15.771089 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 19:31:15.771089 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 19:31:15.771089 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 19:31:15.771089 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 19:31:15.771089 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 19:31:15.771089 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 19:31:15.771089 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 19:31:15.771089 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 19:31:15.771089 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 19:31:15.771089 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 19:31:15.771089 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 19:31:15.771089 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 19:31:15.772064 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 19:31:15.772064 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application with Lock( Aug 18 19:31:15.772064 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 19:31:15.772064 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self._enter() Aug 18 19:31:15.772064 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 19:31:15.772064 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 19:31:15.772064 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 19:31:15.772064 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application return self.creator() Aug 18 19:31:15.772064 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 19:31:15.772064 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application created_value = creator( Aug 18 19:31:15.772064 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 19:31:15.772064 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 19:31:15.772064 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 19:31:15.772064 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: ERROR keystone.server.flask.application Aug 18 19:31:15.772064 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 454/925] 10.222.0.23 () {56 vars in 1117 bytes} [Thu Aug 18 19:31:15 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 19:31:15.777548 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca38634-a60f-4af9-8fca-89c6550a643e None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:31:15.852765 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:31:15.874077 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca38634-a60f-4af9-8fca-89c6550a643e None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:31:15.906969 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc1951a-153e-470a-94c2-7ab0aca24bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:31:15.907580 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc1951a-153e-470a-94c2-7ab0aca24bbf None admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:31:15.907891 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc1951a-153e-470a-94c2-7ab0aca24bbf None admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:31:15.908164 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc1951a-153e-470a-94c2-7ab0aca24bbf None admin] PATH_INFO: `/v3/services` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:31:15.908790 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc1951a-153e-470a-94c2-7ab0aca24bbf None admin] RBAC: Adding query filter params (name=placement) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:31:15.909092 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc1951a-153e-470a-94c2-7ab0aca24bbf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:31:15.910595 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc1951a-153e-470a-94c2-7ab0aca24bbf None admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:31:15.916172 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 472/926] 10.222.0.23 () {56 vars in 1116 bytes} [Thu Aug 18 19:31:15 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:31:15.921946 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce51314-0692-4b80-a56d-f5ee973e54df None admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:31:16.021341 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce51314-0692-4b80-a56d-f5ee973e54df None admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:31:16.055061 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a70e00-2010-4609-9114-adc289dd0cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:31:16.055728 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a70e00-2010-4609-9114-adc289dd0cf4 None admin] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:31:16.056004 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a70e00-2010-4609-9114-adc289dd0cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:31:16.056271 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a70e00-2010-4609-9114-adc289dd0cf4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:31:16.056915 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a70e00-2010-4609-9114-adc289dd0cf4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:31:16.058300 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a70e00-2010-4609-9114-adc289dd0cf4 None admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:31:16.162679 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 455/927] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Aug 18 19:31:15 2022] POST /identity/v3/endpoints => generated 331 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 19:31:25.939963 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=30 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:31:26.158004 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:37:01.810454 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691384fd-f39b-443c-a44e-3fb721b0df74 None None] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:37:01.811505 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691384fd-f39b-443c-a44e-3fb721b0df74 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:37:01.811505 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691384fd-f39b-443c-a44e-3fb721b0df74 None None] PATH_INFO: `/` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:37:01.812881 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 473/928] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:37:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:37:01.818500 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625fd443-a009-442c-82d4-9f42557c2a3e None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:37:01.818929 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625fd443-a009-442c-82d4-9f42557c2a3e None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:37:01.819122 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625fd443-a009-442c-82d4-9f42557c2a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:37:01.911750 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-625fd443-a009-442c-82d4-9f42557c2a3e None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:37:01.913014 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-625fd443-a009-442c-82d4-9f42557c2a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:37:02.034615 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 456/929] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:37:01 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:37:02.401973 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2dbfa0-baa9-47b3-8d6c-cba6ad46f9de None None] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:37:02.402362 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2dbfa0-baa9-47b3-8d6c-cba6ad46f9de None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:37:02.402643 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2dbfa0-baa9-47b3-8d6c-cba6ad46f9de None None] PATH_INFO: `/` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:37:02.404914 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 474/930] 10.222.0.23 () {54 vars in 965 bytes} [Thu Aug 18 19:37:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:37:02.412083 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b00e559-e7d9-4cbf-b50a-ce59f1b8f1d6 None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:37:02.412588 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b00e559-e7d9-4cbf-b50a-ce59f1b8f1d6 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:37:02.413685 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b00e559-e7d9-4cbf-b50a-ce59f1b8f1d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:37:02.465725 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-5b00e559-e7d9-4cbf-b50a-ce59f1b8f1d6 None None] MFA Rules not processed for user `516923ce386f459190af3fd7eaa81551`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:37:02.467682 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-5b00e559-e7d9-4cbf-b50a-ce59f1b8f1d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:37:02.520494 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:37:02.528939 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 457/931] 10.222.0.23 () {58 vars in 1062 bytes} [Thu Aug 18 19:37:02 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:37:02.538414 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2dbfa0-baa9-47b3-8d6c-cba6ad46f9de None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:37:02.549495 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2dbfa0-baa9-47b3-8d6c-cba6ad46f9de None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:37:02.553029 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69207e1-e46f-4973-8fbf-1ef9c9600050 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '516923ce386f459190af3fd7eaa81551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a44b197c3aa0479092f4d77d2c791c39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:37:02.553623 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69207e1-e46f-4973-8fbf-1ef9c9600050 service neutron] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:37:02.553938 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69207e1-e46f-4973-8fbf-1ef9c9600050 service neutron] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:37:02.554208 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69207e1-e46f-4973-8fbf-1ef9c9600050 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:37:02.563638 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69207e1-e46f-4973-8fbf-1ef9c9600050 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:37:02.565072 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69207e1-e46f-4973-8fbf-1ef9c9600050 service neutron] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:37:02.574938 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 475/932] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Aug 18 19:37:02 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 19:37:05.098611 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56614079-bfb0-47ef-af8a-94b17cd1c485 None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:37:05.099148 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56614079-bfb0-47ef-af8a-94b17cd1c485 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:37:05.099148 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56614079-bfb0-47ef-af8a-94b17cd1c485 None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:37:05.100534 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 458/933] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:37:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:37:05.106441 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd02b7-0152-4d8e-b77b-38538102ebf9 None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:37:05.106946 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd02b7-0152-4d8e-b77b-38538102ebf9 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:37:05.107812 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd02b7-0152-4d8e-b77b-38538102ebf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:37:05.128369 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-d3bd02b7-0152-4d8e-b77b-38538102ebf9 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:37:05.129785 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-d3bd02b7-0152-4d8e-b77b-38538102ebf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:37:05.137817 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 476/934] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:37:05 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:37:05.483482 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56614079-bfb0-47ef-af8a-94b17cd1c485 None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:37:05.494198 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56614079-bfb0-47ef-af8a-94b17cd1c485 None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:37:05.497672 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b6d521-fb3d-4002-a003-f2e2948375da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '516923ce386f459190af3fd7eaa81551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a44b197c3aa0479092f4d77d2c791c39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:37:05.498290 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b6d521-fb3d-4002-a003-f2e2948375da service neutron] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:37:05.498569 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b6d521-fb3d-4002-a003-f2e2948375da service neutron] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:37:05.498865 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b6d521-fb3d-4002-a003-f2e2948375da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:37:05.507881 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b6d521-fb3d-4002-a003-f2e2948375da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:37:05.509313 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b6d521-fb3d-4002-a003-f2e2948375da service neutron] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:37:05.519828 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 459/935] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Aug 18 19:37:05 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:37:08.214830 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f008d9-61cb-46d8-ae6f-18e4802b1c07 None None] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:37:08.215351 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f008d9-61cb-46d8-ae6f-18e4802b1c07 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:37:08.215351 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f008d9-61cb-46d8-ae6f-18e4802b1c07 None None] PATH_INFO: `/` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:37:08.216878 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 477/936] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:37:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:37:08.222159 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96094253-1ceb-4299-9029-45e71d0e0de8 None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:37:08.222613 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96094253-1ceb-4299-9029-45e71d0e0de8 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:37:08.222709 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96094253-1ceb-4299-9029-45e71d0e0de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:37:08.259912 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-96094253-1ceb-4299-9029-45e71d0e0de8 None None] MFA Rules not processed for user `10bd00684b524d61b436781e07111a43`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:37:08.261388 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-96094253-1ceb-4299-9029-45e71d0e0de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:37:08.332283 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 460/937] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:37:08 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:37:08.680712 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f008d9-61cb-46d8-ae6f-18e4802b1c07 None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:37:08.692427 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f008d9-61cb-46d8-ae6f-18e4802b1c07 None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:37:08.695913 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418f0b56-ae08-4c8a-91a6-d3e2803ba928 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '516923ce386f459190af3fd7eaa81551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a44b197c3aa0479092f4d77d2c791c39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:37:08.696530 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f0b56-ae08-4c8a-91a6-d3e2803ba928 service neutron] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:37:08.696809 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f0b56-ae08-4c8a-91a6-d3e2803ba928 service neutron] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:37:08.697081 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f0b56-ae08-4c8a-91a6-d3e2803ba928 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:37:08.706798 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418f0b56-ae08-4c8a-91a6-d3e2803ba928 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:37:08.708268 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418f0b56-ae08-4c8a-91a6-d3e2803ba928 service neutron] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:37:08.718749 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 478/938] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Aug 18 19:37:08 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:37:11.636188 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c9b7c-8115-401b-9759-4a8ea9d50c4b None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:37:11.636712 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c9b7c-8115-401b-9759-4a8ea9d50c4b None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:37:11.636712 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c9b7c-8115-401b-9759-4a8ea9d50c4b None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:37:11.638114 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 461/939] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:37:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:37:11.643080 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2e03b-1bad-483d-940f-9da1c4d8df53 None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:37:11.643525 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2e03b-1bad-483d-940f-9da1c4d8df53 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:37:11.643636 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2e03b-1bad-483d-940f-9da1c4d8df53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:37:11.662380 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-f3a2e03b-1bad-483d-940f-9da1c4d8df53 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:37:11.663588 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-f3a2e03b-1bad-483d-940f-9da1c4d8df53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:37:11.730450 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 479/940] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:37:11 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:37:12.069056 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86c9b7c-8115-401b-9759-4a8ea9d50c4b None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:37:12.086375 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86c9b7c-8115-401b-9759-4a8ea9d50c4b None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:37:12.089771 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e479ba2e-a270-4be9-8023-30b386ab4168 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '516923ce386f459190af3fd7eaa81551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a44b197c3aa0479092f4d77d2c791c39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:37:12.090364 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e479ba2e-a270-4be9-8023-30b386ab4168 service neutron] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:37:12.090657 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e479ba2e-a270-4be9-8023-30b386ab4168 service neutron] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:37:12.091593 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e479ba2e-a270-4be9-8023-30b386ab4168 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:37:12.100359 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e479ba2e-a270-4be9-8023-30b386ab4168 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:37:12.101806 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e479ba2e-a270-4be9-8023-30b386ab4168 service neutron] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:37:12.111255 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 462/941] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Aug 18 19:37:12 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:37:15.316912 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02db0621-1185-4fff-9a1e-4c328e8fc2b6 None None] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:37:15.317455 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02db0621-1185-4fff-9a1e-4c328e8fc2b6 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:37:15.317455 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02db0621-1185-4fff-9a1e-4c328e8fc2b6 None None] PATH_INFO: `/` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:37:15.318744 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 480/942] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:37:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:37:15.324087 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ca8f20-ac09-4494-9e60-a0b3af75507a None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:37:15.325503 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ca8f20-ac09-4494-9e60-a0b3af75507a None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:37:15.325503 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ca8f20-ac09-4494-9e60-a0b3af75507a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:37:15.345242 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-c0ca8f20-ac09-4494-9e60-a0b3af75507a None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:37:15.346472 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-c0ca8f20-ac09-4494-9e60-a0b3af75507a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:37:15.355095 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 463/943] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:37:15 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:37:15.702616 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02db0621-1185-4fff-9a1e-4c328e8fc2b6 None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:37:15.712993 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02db0621-1185-4fff-9a1e-4c328e8fc2b6 None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:37:15.716393 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036289ea-fe36-4360-acf0-e10679f63f67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '516923ce386f459190af3fd7eaa81551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a44b197c3aa0479092f4d77d2c791c39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:37:15.716970 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036289ea-fe36-4360-acf0-e10679f63f67 service neutron] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:37:15.717245 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036289ea-fe36-4360-acf0-e10679f63f67 service neutron] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:37:15.717513 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036289ea-fe36-4360-acf0-e10679f63f67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:37:15.726004 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036289ea-fe36-4360-acf0-e10679f63f67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:37:15.727419 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036289ea-fe36-4360-acf0-e10679f63f67 service neutron] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:37:15.736805 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 481/944] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Aug 18 19:37:15 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:37:17.950017 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef15826e-fff9-484a-bb71-81c239280ea3 None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:37:17.950576 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef15826e-fff9-484a-bb71-81c239280ea3 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:37:17.950576 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef15826e-fff9-484a-bb71-81c239280ea3 None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:37:17.951905 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 464/945] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:37:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:37:17.956996 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4d2b31-b7f7-4c1c-86fd-9de86766dd06 None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:37:17.957430 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4d2b31-b7f7-4c1c-86fd-9de86766dd06 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:37:17.957578 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4d2b31-b7f7-4c1c-86fd-9de86766dd06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:37:17.976904 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-cc4d2b31-b7f7-4c1c-86fd-9de86766dd06 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:37:17.978119 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-cc4d2b31-b7f7-4c1c-86fd-9de86766dd06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:37:17.986317 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 482/946] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:37:17 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:37:18.319540 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef15826e-fff9-484a-bb71-81c239280ea3 None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:37:18.331026 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef15826e-fff9-484a-bb71-81c239280ea3 None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:37:18.334729 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91d389d-e837-4cca-bec3-971508b76034 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '516923ce386f459190af3fd7eaa81551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a44b197c3aa0479092f4d77d2c791c39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:37:18.335365 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91d389d-e837-4cca-bec3-971508b76034 service neutron] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:37:18.335646 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91d389d-e837-4cca-bec3-971508b76034 service neutron] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:37:18.335920 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91d389d-e837-4cca-bec3-971508b76034 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:37:18.346558 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91d389d-e837-4cca-bec3-971508b76034 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:37:18.347996 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91d389d-e837-4cca-bec3-971508b76034 service neutron] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:37:18.358089 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 465/947] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Aug 18 19:37:18 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:37:20.574771 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359e8559-f266-4747-ae4b-e372ce964dbd None None] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:37:20.575331 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359e8559-f266-4747-ae4b-e372ce964dbd None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:37:20.575331 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359e8559-f266-4747-ae4b-e372ce964dbd None None] PATH_INFO: `/` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:37:20.576684 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 483/948] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:37:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:37:20.582003 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e7824-5c0f-4a2f-88cb-28df259fbbf9 None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:37:20.582385 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e7824-5c0f-4a2f-88cb-28df259fbbf9 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:37:20.582472 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e7824-5c0f-4a2f-88cb-28df259fbbf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:37:20.611038 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-f47e7824-5c0f-4a2f-88cb-28df259fbbf9 None None] MFA Rules not processed for user `10bd00684b524d61b436781e07111a43`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:37:20.612213 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-f47e7824-5c0f-4a2f-88cb-28df259fbbf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:37:20.635373 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 466/949] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:37:20 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:37:20.979698 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359e8559-f266-4747-ae4b-e372ce964dbd None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:37:20.998019 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359e8559-f266-4747-ae4b-e372ce964dbd None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:37:21.001460 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefcfcb1-f95d-4425-913f-89303bcbb3f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '516923ce386f459190af3fd7eaa81551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a44b197c3aa0479092f4d77d2c791c39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:37:21.002107 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefcfcb1-f95d-4425-913f-89303bcbb3f0 service neutron] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:37:21.002385 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefcfcb1-f95d-4425-913f-89303bcbb3f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:37:21.002653 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefcfcb1-f95d-4425-913f-89303bcbb3f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:37:21.011544 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefcfcb1-f95d-4425-913f-89303bcbb3f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:37:21.012967 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefcfcb1-f95d-4425-913f-89303bcbb3f0 service neutron] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:37:21.022354 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 484/950] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Aug 18 19:37:20 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:37:23.804584 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3d0ffe-6f2e-4ecc-bb81-7d5915274de3 None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:37:23.805155 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3d0ffe-6f2e-4ecc-bb81-7d5915274de3 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:37:23.805155 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3d0ffe-6f2e-4ecc-bb81-7d5915274de3 None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:37:23.806546 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 467/951] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:37:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:37:23.811720 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae405a6-2c80-4502-adb1-cf620f296274 None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:37:23.812399 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae405a6-2c80-4502-adb1-cf620f296274 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:37:23.812522 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae405a6-2c80-4502-adb1-cf620f296274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:37:23.831097 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-eae405a6-2c80-4502-adb1-cf620f296274 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:37:23.832267 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-eae405a6-2c80-4502-adb1-cf620f296274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:37:23.840715 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 485/952] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:37:23 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:37:24.182580 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3d0ffe-6f2e-4ecc-bb81-7d5915274de3 None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:37:24.193547 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3d0ffe-6f2e-4ecc-bb81-7d5915274de3 None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:37:24.198049 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2f4dc4-4935-4b14-8fb5-5e0f13bbbdd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '516923ce386f459190af3fd7eaa81551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a44b197c3aa0479092f4d77d2c791c39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:37:24.198927 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2f4dc4-4935-4b14-8fb5-5e0f13bbbdd0 service neutron] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:37:24.199818 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2f4dc4-4935-4b14-8fb5-5e0f13bbbdd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:37:24.200199 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2f4dc4-4935-4b14-8fb5-5e0f13bbbdd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:37:24.209510 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2f4dc4-4935-4b14-8fb5-5e0f13bbbdd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:37:24.210976 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2f4dc4-4935-4b14-8fb5-5e0f13bbbdd0 service neutron] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:37:24.221063 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 468/953] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Aug 18 19:37:24 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:37:26.471882 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87260ef-41e4-474d-9453-a06b4ab2f2f8 None None] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:37:26.472280 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87260ef-41e4-474d-9453-a06b4ab2f2f8 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:37:26.472429 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87260ef-41e4-474d-9453-a06b4ab2f2f8 None None] PATH_INFO: `/` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:37:26.473923 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 486/954] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:37:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:37:26.479526 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2544aa6-6bdf-4b78-9943-5d6338784cbb None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:37:26.479953 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2544aa6-6bdf-4b78-9943-5d6338784cbb None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:37:26.480082 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2544aa6-6bdf-4b78-9943-5d6338784cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:37:26.499928 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-b2544aa6-6bdf-4b78-9943-5d6338784cbb None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:37:26.501131 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-b2544aa6-6bdf-4b78-9943-5d6338784cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:37:26.508984 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 469/955] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:37:26 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 19:37:26.857974 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87260ef-41e4-474d-9453-a06b4ab2f2f8 None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:37:26.863335 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=65 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:37:26.868910 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87260ef-41e4-474d-9453-a06b4ab2f2f8 None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:37:26.872415 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617859a6-f118-424a-80c4-8dbecb752608 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '516923ce386f459190af3fd7eaa81551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a44b197c3aa0479092f4d77d2c791c39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:37:26.873002 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617859a6-f118-424a-80c4-8dbecb752608 service neutron] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:37:26.873277 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617859a6-f118-424a-80c4-8dbecb752608 service neutron] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:37:26.873548 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617859a6-f118-424a-80c4-8dbecb752608 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:37:26.883878 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617859a6-f118-424a-80c4-8dbecb752608 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:37:26.883975 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617859a6-f118-424a-80c4-8dbecb752608 service neutron] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:37:26.893189 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 487/956] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Aug 18 19:37:26 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:37:29.708188 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e7dc9a-7bec-46f6-9759-3efbe8c8839f None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:37:29.708738 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e7dc9a-7bec-46f6-9759-3efbe8c8839f None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:37:29.708738 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e7dc9a-7bec-46f6-9759-3efbe8c8839f None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:37:29.710089 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 470/957] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:37:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:37:29.715742 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82919fc1-6cb2-464f-9d95-30247f736cac None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:37:29.716185 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82919fc1-6cb2-464f-9d95-30247f736cac None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:37:29.716298 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82919fc1-6cb2-464f-9d95-30247f736cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:37:29.735301 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-82919fc1-6cb2-464f-9d95-30247f736cac None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:37:29.736452 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-82919fc1-6cb2-464f-9d95-30247f736cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:37:29.744175 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 488/958] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:37:29 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:37:30.090926 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91690f4d-1bf5-4871-87d2-65e503673a04 None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:37:30.091209 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91690f4d-1bf5-4871-87d2-65e503673a04 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:37:30.091483 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91690f4d-1bf5-4871-87d2-65e503673a04 None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:37:30.092826 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 471/959] 10.222.0.23 () {54 vars in 965 bytes} [Thu Aug 18 19:37:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:37:30.098721 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb5678-515d-418f-84cb-f6c23321eb24 None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:37:30.099009 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb5678-515d-418f-84cb-f6c23321eb24 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:37:30.099281 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb5678-515d-418f-84cb-f6c23321eb24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:37:30.133759 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-41bb5678-515d-418f-84cb-f6c23321eb24 None None] MFA Rules not processed for user `516923ce386f459190af3fd7eaa81551`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:37:30.134960 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-41bb5678-515d-418f-84cb-f6c23321eb24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:37:30.151179 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 489/960] 10.222.0.23 () {58 vars in 1062 bytes} [Thu Aug 18 19:37:30 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:37:30.160514 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91690f4d-1bf5-4871-87d2-65e503673a04 None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:37:30.170988 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91690f4d-1bf5-4871-87d2-65e503673a04 None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:37:30.174488 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1f5531-a3f4-45dc-becd-b59810a768b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '516923ce386f459190af3fd7eaa81551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a44b197c3aa0479092f4d77d2c791c39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:37:30.175079 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1f5531-a3f4-45dc-becd-b59810a768b2 service neutron] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:37:30.175362 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1f5531-a3f4-45dc-becd-b59810a768b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:37:30.175634 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1f5531-a3f4-45dc-becd-b59810a768b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:37:30.184407 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1f5531-a3f4-45dc-becd-b59810a768b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:37:30.185860 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1f5531-a3f4-45dc-becd-b59810a768b2 service neutron] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:37:30.195244 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 472/961] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Aug 18 19:37:30 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:37:35.106845 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef90a5-57d6-488f-adc5-070caf2ca783 None None] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:37:35.107420 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef90a5-57d6-488f-adc5-070caf2ca783 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:37:35.107420 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef90a5-57d6-488f-adc5-070caf2ca783 None None] PATH_INFO: `/` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:37:35.108855 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 490/962] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:37:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:37:35.113857 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0059d19e-05d3-44ec-99ed-f137a29d31b4 None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:37:35.114246 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0059d19e-05d3-44ec-99ed-f137a29d31b4 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:37:35.114406 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0059d19e-05d3-44ec-99ed-f137a29d31b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:37:35.122437 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=93 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:37:35.135016 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-0059d19e-05d3-44ec-99ed-f137a29d31b4 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:37:35.136226 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-0059d19e-05d3-44ec-99ed-f137a29d31b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:37:35.143841 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 473/963] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:37:35 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:37:35.485722 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ef90a5-57d6-488f-adc5-070caf2ca783 None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:37:35.496304 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ef90a5-57d6-488f-adc5-070caf2ca783 None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:37:35.499834 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09db8058-3469-4967-b2b7-e944206596fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '516923ce386f459190af3fd7eaa81551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a44b197c3aa0479092f4d77d2c791c39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:37:35.500422 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09db8058-3469-4967-b2b7-e944206596fa service neutron] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:37:35.500702 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09db8058-3469-4967-b2b7-e944206596fa service neutron] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:37:35.500975 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09db8058-3469-4967-b2b7-e944206596fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:37:35.509707 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09db8058-3469-4967-b2b7-e944206596fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:37:35.511680 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09db8058-3469-4967-b2b7-e944206596fa service neutron] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:37:35.520854 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 491/964] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Aug 18 19:37:35 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:37:38.806490 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebc1e8a-a873-4662-a7c5-df99e1cfefc2 None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:37:38.807021 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebc1e8a-a873-4662-a7c5-df99e1cfefc2 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:37:38.807021 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebc1e8a-a873-4662-a7c5-df99e1cfefc2 None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:37:38.808369 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 474/965] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:37:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:37:38.813790 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd444057-fb13-4c46-9156-f083831a358a None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:37:38.814198 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd444057-fb13-4c46-9156-f083831a358a None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:37:38.814342 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd444057-fb13-4c46-9156-f083831a358a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:37:38.833377 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-bd444057-fb13-4c46-9156-f083831a358a None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:37:38.834602 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-bd444057-fb13-4c46-9156-f083831a358a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:37:38.842905 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 492/966] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:37:38 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:37:39.187357 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebc1e8a-a873-4662-a7c5-df99e1cfefc2 None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:37:39.199292 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebc1e8a-a873-4662-a7c5-df99e1cfefc2 None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:37:39.202814 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a945ed-e501-4445-881b-6e5e730034d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '516923ce386f459190af3fd7eaa81551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a44b197c3aa0479092f4d77d2c791c39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:37:39.203410 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a945ed-e501-4445-881b-6e5e730034d4 service neutron] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:37:39.203689 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a945ed-e501-4445-881b-6e5e730034d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:37:39.203965 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a945ed-e501-4445-881b-6e5e730034d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:37:39.213011 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a945ed-e501-4445-881b-6e5e730034d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:37:39.215058 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a945ed-e501-4445-881b-6e5e730034d4 service neutron] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:37:39.224544 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 475/967] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Aug 18 19:37:39 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:37:43.584973 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ebf358-0a6d-44b8-9088-2a173c1d970d None None] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:37:43.585471 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ebf358-0a6d-44b8-9088-2a173c1d970d None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:37:43.585471 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ebf358-0a6d-44b8-9088-2a173c1d970d None None] PATH_INFO: `/` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:37:43.586968 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 493/968] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:37:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:37:43.592218 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ddc770-0440-4514-9038-0e015484ca51 None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:37:43.592643 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ddc770-0440-4514-9038-0e015484ca51 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:37:43.592766 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ddc770-0440-4514-9038-0e015484ca51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:37:43.612361 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-d1ddc770-0440-4514-9038-0e015484ca51 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:37:43.613539 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-d1ddc770-0440-4514-9038-0e015484ca51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:37:43.621985 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 476/969] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:37:43 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:37:43.959529 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ebf358-0a6d-44b8-9088-2a173c1d970d None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:37:43.970528 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ebf358-0a6d-44b8-9088-2a173c1d970d None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:37:43.973959 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2158b6f2-6817-4a14-8189-7f0712baccdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '516923ce386f459190af3fd7eaa81551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a44b197c3aa0479092f4d77d2c791c39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:37:43.974536 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2158b6f2-6817-4a14-8189-7f0712baccdf service neutron] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:37:43.974819 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2158b6f2-6817-4a14-8189-7f0712baccdf service neutron] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:37:43.975080 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2158b6f2-6817-4a14-8189-7f0712baccdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:37:43.984290 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2158b6f2-6817-4a14-8189-7f0712baccdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:37:43.985773 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2158b6f2-6817-4a14-8189-7f0712baccdf service neutron] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:37:43.994834 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 494/970] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Aug 18 19:37:43 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:37:49.424389 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f642147-1d2b-4d41-8751-860ba0a45bc6 None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:37:49.424942 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f642147-1d2b-4d41-8751-860ba0a45bc6 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:37:49.424942 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f642147-1d2b-4d41-8751-860ba0a45bc6 None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:37:49.426631 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 477/971] 10.222.0.23 () {54 vars in 921 bytes} [Thu Aug 18 19:37:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:37:49.431956 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e240d-a43d-4ed3-834a-38d1e5871be7 None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:37:49.432731 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e240d-a43d-4ed3-834a-38d1e5871be7 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:37:49.433156 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e240d-a43d-4ed3-834a-38d1e5871be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:37:49.481253 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-374e240d-a43d-4ed3-834a-38d1e5871be7 None None] MFA Rules not processed for user `b80a74afafd94acd8703fda561e1e4cd`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:37:49.482657 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-374e240d-a43d-4ed3-834a-38d1e5871be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:37:49.559856 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 495/972] 10.222.0.23 () {58 vars in 1018 bytes} [Thu Aug 18 19:37:49 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 19:37:53.607369 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=11 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:37:54.014960 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acdb2b6-e6ea-43d2-989f-ef5b912dfed0 None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:37:54.015362 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acdb2b6-e6ea-43d2-989f-ef5b912dfed0 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:37:54.015501 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acdb2b6-e6ea-43d2-989f-ef5b912dfed0 None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:37:54.017016 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 478/973] 10.222.0.23 () {54 vars in 921 bytes} [Thu Aug 18 19:37:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:37:54.021781 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b41826-6f5b-4dc5-bc91-562c8b6ccb72 None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:37:54.022241 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b41826-6f5b-4dc5-bc91-562c8b6ccb72 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:37:54.022616 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b41826-6f5b-4dc5-bc91-562c8b6ccb72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:37:54.042786 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-f5b41826-6f5b-4dc5-bc91-562c8b6ccb72 None None] MFA Rules not processed for user `b80a74afafd94acd8703fda561e1e4cd`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:37:54.043963 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-f5b41826-6f5b-4dc5-bc91-562c8b6ccb72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:37:54.052740 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 496/974] 10.222.0.23 () {58 vars in 1018 bytes} [Thu Aug 18 19:37:54 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:37:55.761211 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efc12b7-91ec-48bc-ad82-0b6477e341de None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:37:55.761765 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efc12b7-91ec-48bc-ad82-0b6477e341de None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:37:55.761765 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efc12b7-91ec-48bc-ad82-0b6477e341de None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:37:55.763118 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 479/975] 10.222.0.23 () {54 vars in 921 bytes} [Thu Aug 18 19:37:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:37:55.767980 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c9e486-c87b-43e0-b804-54a2e1578971 None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:37:55.768421 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c9e486-c87b-43e0-b804-54a2e1578971 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:37:55.768650 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c9e486-c87b-43e0-b804-54a2e1578971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:37:55.788597 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-69c9e486-c87b-43e0-b804-54a2e1578971 None None] MFA Rules not processed for user `b80a74afafd94acd8703fda561e1e4cd`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:37:55.789826 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-69c9e486-c87b-43e0-b804-54a2e1578971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:37:55.798301 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 497/976] 10.222.0.23 () {58 vars in 1018 bytes} [Thu Aug 18 19:37:55 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:37:59.590607 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1280c74c-3a83-4520-80f8-aa2095de01eb None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:37:59.592029 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1280c74c-3a83-4520-80f8-aa2095de01eb None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:37:59.592766 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1280c74c-3a83-4520-80f8-aa2095de01eb None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:37:59.596074 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 480/977] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:37:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:37:59.601987 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4252582-a568-4f9a-9837-5e7d342f0c09 None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:37:59.602866 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4252582-a568-4f9a-9837-5e7d342f0c09 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:37:59.603284 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4252582-a568-4f9a-9837-5e7d342f0c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:37:59.611693 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=80 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:37:59.626590 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-f4252582-a568-4f9a-9837-5e7d342f0c09 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:37:59.627786 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-f4252582-a568-4f9a-9837-5e7d342f0c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:37:59.636300 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 498/978] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:37:59 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:37:59.994285 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80e1711-4d62-4dac-aa9e-a259e7841762 None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:37:59.994822 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80e1711-4d62-4dac-aa9e-a259e7841762 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:37:59.995319 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80e1711-4d62-4dac-aa9e-a259e7841762 None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:37:59.997288 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 481/979] 10.222.0.23 () {54 vars in 962 bytes} [Thu Aug 18 19:37:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:38:00.006479 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e4da89-ab09-43ca-a23e-7f890a5a6930 None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:38:00.016495 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e4da89-ab09-43ca-a23e-7f890a5a6930 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:38:00.016495 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e4da89-ab09-43ca-a23e-7f890a5a6930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:38:00.050160 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-e0e4da89-ab09-43ca-a23e-7f890a5a6930 None None] MFA Rules not processed for user `9c3560e900d248bc93147ddce515365b`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:38:00.051407 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-e0e4da89-ab09-43ca-a23e-7f890a5a6930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:38:00.139520 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 499/980] 10.222.0.23 () {58 vars in 1059 bytes} [Thu Aug 18 19:38:00 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:38:00.147649 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80e1711-4d62-4dac-aa9e-a259e7841762 None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:38:00.162527 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80e1711-4d62-4dac-aa9e-a259e7841762 None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:38:00.168633 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7f8b12-ef04-421e-b5e2-e5a7f351ddd1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c3560e900d248bc93147ddce515365b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a44b197c3aa0479092f4d77d2c791c39', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:38:00.169460 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f8b12-ef04-421e-b5e2-e5a7f351ddd1 service nova] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:38:00.169979 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f8b12-ef04-421e-b5e2-e5a7f351ddd1 service nova] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:38:00.170430 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f8b12-ef04-421e-b5e2-e5a7f351ddd1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:38:00.179598 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7f8b12-ef04-421e-b5e2-e5a7f351ddd1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:38:00.181980 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7f8b12-ef04-421e-b5e2-e5a7f351ddd1 service nova] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:38:00.192316 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 482/981] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Aug 18 19:38:00 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 19:38:02.597877 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90da0d0-f4a5-4c67-b70a-d23352ae9370 None None] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:38:02.598441 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90da0d0-f4a5-4c67-b70a-d23352ae9370 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:38:02.598441 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90da0d0-f4a5-4c67-b70a-d23352ae9370 None None] PATH_INFO: `/` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:38:02.599880 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 500/982] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:38:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:38:02.605878 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f655c908-aa81-401c-b38c-f2464a753d11 None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:38:02.605878 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f655c908-aa81-401c-b38c-f2464a753d11 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:38:02.605878 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f655c908-aa81-401c-b38c-f2464a753d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:38:02.625874 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-f655c908-aa81-401c-b38c-f2464a753d11 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:38:02.627052 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-f655c908-aa81-401c-b38c-f2464a753d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:38:02.635531 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 483/983] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:38:02 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 19:38:02.984600 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90da0d0-f4a5-4c67-b70a-d23352ae9370 None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:38:02.998787 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90da0d0-f4a5-4c67-b70a-d23352ae9370 None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:38:03.003668 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db390aad-6cf6-4f0e-8a57-123dd45fadbb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c3560e900d248bc93147ddce515365b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a44b197c3aa0479092f4d77d2c791c39', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:38:03.004310 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db390aad-6cf6-4f0e-8a57-123dd45fadbb service nova] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:38:03.004585 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db390aad-6cf6-4f0e-8a57-123dd45fadbb service nova] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:38:03.004851 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db390aad-6cf6-4f0e-8a57-123dd45fadbb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:38:03.014026 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db390aad-6cf6-4f0e-8a57-123dd45fadbb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:38:03.015950 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db390aad-6cf6-4f0e-8a57-123dd45fadbb service nova] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:38:03.029957 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 501/984] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Aug 18 19:38:02 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:38:05.671662 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03830673-e0d7-4699-af14-53a9be271c0b None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:38:05.671662 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03830673-e0d7-4699-af14-53a9be271c0b None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:38:05.671662 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03830673-e0d7-4699-af14-53a9be271c0b None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:38:05.672628 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 484/985] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:38:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:38:05.677876 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f315fc-b30c-41f8-87e3-51c36ffb1f73 None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:38:05.678313 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f315fc-b30c-41f8-87e3-51c36ffb1f73 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:38:05.678430 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f315fc-b30c-41f8-87e3-51c36ffb1f73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:38:05.698911 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-80f315fc-b30c-41f8-87e3-51c36ffb1f73 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:38:05.700302 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-80f315fc-b30c-41f8-87e3-51c36ffb1f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:38:05.708147 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 502/986] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:38:05 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:38:06.058957 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f7375a-3f8a-4a96-8d5c-d78f3448aaeb None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:38:06.059243 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f7375a-3f8a-4a96-8d5c-d78f3448aaeb None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:38:06.059520 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f7375a-3f8a-4a96-8d5c-d78f3448aaeb None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:38:06.061959 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 485/987] 10.222.0.23 () {54 vars in 962 bytes} [Thu Aug 18 19:38:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:38:06.067654 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15c595c-3619-4480-af0f-bcccb1929351 None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:38:06.068233 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15c595c-3619-4480-af0f-bcccb1929351 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:38:06.068716 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15c595c-3619-4480-af0f-bcccb1929351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:38:06.097070 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-e15c595c-3619-4480-af0f-bcccb1929351 None None] MFA Rules not processed for user `9c3560e900d248bc93147ddce515365b`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:38:06.099470 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-e15c595c-3619-4480-af0f-bcccb1929351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:38:06.111714 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 503/988] 10.222.0.23 () {58 vars in 1059 bytes} [Thu Aug 18 19:38:06 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:38:06.120558 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f7375a-3f8a-4a96-8d5c-d78f3448aaeb None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:38:06.135341 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f7375a-3f8a-4a96-8d5c-d78f3448aaeb None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:38:06.140720 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fd4564-894d-427d-9d51-e78273cf149b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c3560e900d248bc93147ddce515365b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a44b197c3aa0479092f4d77d2c791c39', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:38:06.141325 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd4564-894d-427d-9d51-e78273cf149b service nova] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:38:06.141808 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd4564-894d-427d-9d51-e78273cf149b service nova] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:38:06.142078 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd4564-894d-427d-9d51-e78273cf149b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:38:06.151003 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fd4564-894d-427d-9d51-e78273cf149b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:38:06.152840 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fd4564-894d-427d-9d51-e78273cf149b service nova] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:38:06.163585 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 486/989] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Aug 18 19:38:06 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:38:08.635347 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789448ad-0977-4bb3-921a-7463d313d7c1 None None] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:38:08.635910 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789448ad-0977-4bb3-921a-7463d313d7c1 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:38:08.635910 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789448ad-0977-4bb3-921a-7463d313d7c1 None None] PATH_INFO: `/` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:38:08.642577 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34eb49b-5351-4899-adfb-a2c463c45a8e None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:38:08.643408 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34eb49b-5351-4899-adfb-a2c463c45a8e None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:38:08.643905 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34eb49b-5351-4899-adfb-a2c463c45a8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:38:08.649266 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 504/990] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:38:08 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:38:08.664838 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-c34eb49b-5351-4899-adfb-a2c463c45a8e None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:38:08.666386 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-c34eb49b-5351-4899-adfb-a2c463c45a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:38:08.682110 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 487/991] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:38:08 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:38:09.029796 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789448ad-0977-4bb3-921a-7463d313d7c1 None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:38:09.044456 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789448ad-0977-4bb3-921a-7463d313d7c1 None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:38:09.050889 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ee5b81-9131-4c5e-9f46-831343a85eec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c3560e900d248bc93147ddce515365b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a44b197c3aa0479092f4d77d2c791c39', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:38:09.050889 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee5b81-9131-4c5e-9f46-831343a85eec service nova] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:38:09.051299 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee5b81-9131-4c5e-9f46-831343a85eec service nova] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:38:09.051769 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee5b81-9131-4c5e-9f46-831343a85eec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:38:09.074398 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ee5b81-9131-4c5e-9f46-831343a85eec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:38:09.076299 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ee5b81-9131-4c5e-9f46-831343a85eec service nova] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:38:09.100388 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 505/992] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Aug 18 19:38:09 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:38:10.134195 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc2f95-edeb-47fb-874e-da519fd2ae92 None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:38:10.134607 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc2f95-edeb-47fb-874e-da519fd2ae92 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:38:10.134699 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc2f95-edeb-47fb-874e-da519fd2ae92 None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:38:10.141254 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb14e6a2-428d-43f9-8f24-53c9a03397c2 None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:38:10.141625 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb14e6a2-428d-43f9-8f24-53c9a03397c2 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:38:10.141751 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb14e6a2-428d-43f9-8f24-53c9a03397c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:38:10.145813 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 488/993] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:38:10 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:38:10.197926 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-cb14e6a2-428d-43f9-8f24-53c9a03397c2 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:38:10.197926 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-cb14e6a2-428d-43f9-8f24-53c9a03397c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:38:10.202371 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 506/994] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:38:10 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:38:10.810896 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856b2a66-e0e7-4b46-800f-b1b227e0dca9 None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:38:10.811257 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856b2a66-e0e7-4b46-800f-b1b227e0dca9 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:38:10.811598 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856b2a66-e0e7-4b46-800f-b1b227e0dca9 None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:38:10.813125 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 489/995] 10.222.0.23 () {54 vars in 964 bytes} [Thu Aug 18 19:38:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:38:10.817894 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5abf6f-9120-493b-93d2-6ae0bbf9f732 None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:38:10.818250 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5abf6f-9120-493b-93d2-6ae0bbf9f732 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:38:10.818593 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5abf6f-9120-493b-93d2-6ae0bbf9f732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:38:10.862579 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-7a5abf6f-9120-493b-93d2-6ae0bbf9f732 None None] MFA Rules not processed for user `28c99ca9206340269f30be592fcd3f75`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:38:10.863790 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-7a5abf6f-9120-493b-93d2-6ae0bbf9f732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:38:10.931639 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 507/996] 10.222.0.23 () {58 vars in 1061 bytes} [Thu Aug 18 19:38:10 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:38:10.939724 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856b2a66-e0e7-4b46-800f-b1b227e0dca9 None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:38:10.951212 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856b2a66-e0e7-4b46-800f-b1b227e0dca9 None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:38:10.954954 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5f9c16-12d1-46fe-acc3-fbb2947c7d3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28c99ca9206340269f30be592fcd3f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a44b197c3aa0479092f4d77d2c791c39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:38:10.955628 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5f9c16-12d1-46fe-acc3-fbb2947c7d3b service cinder] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:38:10.955976 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5f9c16-12d1-46fe-acc3-fbb2947c7d3b service cinder] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:38:10.956317 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5f9c16-12d1-46fe-acc3-fbb2947c7d3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:38:10.966635 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5f9c16-12d1-46fe-acc3-fbb2947c7d3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:38:10.968141 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5f9c16-12d1-46fe-acc3-fbb2947c7d3b service cinder] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:38:10.980885 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 490/997] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Aug 18 19:38:10 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 19:38:11.673533 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0de8ba-7c66-4175-8778-e65975c20cdf None None] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:38:11.674032 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0de8ba-7c66-4175-8778-e65975c20cdf None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:38:11.674194 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0de8ba-7c66-4175-8778-e65975c20cdf None None] PATH_INFO: `/` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:38:11.676824 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 508/998] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:38:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:38:11.681461 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e5776-e2b9-4c5c-b398-d4905130dffb None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:38:11.682307 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e5776-e2b9-4c5c-b398-d4905130dffb None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:38:11.682764 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e5776-e2b9-4c5c-b398-d4905130dffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:38:11.703958 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-d18e5776-e2b9-4c5c-b398-d4905130dffb None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:38:11.705457 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-d18e5776-e2b9-4c5c-b398-d4905130dffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:38:11.731945 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 491/999] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:38:11 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:38:12.065636 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0de8ba-7c66-4175-8778-e65975c20cdf None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:38:12.087654 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0de8ba-7c66-4175-8778-e65975c20cdf None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:38:12.093988 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23deea1-8f7b-494d-9678-09fbed51de24 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c3560e900d248bc93147ddce515365b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a44b197c3aa0479092f4d77d2c791c39', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:38:12.094809 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23deea1-8f7b-494d-9678-09fbed51de24 service nova] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:38:12.095171 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23deea1-8f7b-494d-9678-09fbed51de24 service nova] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:38:12.095521 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23deea1-8f7b-494d-9678-09fbed51de24 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:38:12.106355 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23deea1-8f7b-494d-9678-09fbed51de24 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:38:12.108216 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23deea1-8f7b-494d-9678-09fbed51de24 service nova] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:38:12.113292 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=100 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:38:12.121175 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 509/1000] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Aug 18 19:38:12 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:38:14.451307 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b70c29e-eb08-40c1-a5c0-25bb30c151cc None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:38:14.451854 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b70c29e-eb08-40c1-a5c0-25bb30c151cc None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:38:14.451854 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b70c29e-eb08-40c1-a5c0-25bb30c151cc None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:38:14.453170 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 492/1001] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:38:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:38:14.458401 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dc6597-49ea-4f84-b7fc-1c576ac80ae4 None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:38:14.459187 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dc6597-49ea-4f84-b7fc-1c576ac80ae4 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:38:14.459630 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dc6597-49ea-4f84-b7fc-1c576ac80ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:38:14.485976 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-38dc6597-49ea-4f84-b7fc-1c576ac80ae4 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:38:14.487176 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-38dc6597-49ea-4f84-b7fc-1c576ac80ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:38:14.500527 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 510/1002] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:38:14 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:38:14.841295 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b70c29e-eb08-40c1-a5c0-25bb30c151cc None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:38:14.860656 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b70c29e-eb08-40c1-a5c0-25bb30c151cc None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:38:14.874621 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8999002f-4d98-475e-8247-154264d57511 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c3560e900d248bc93147ddce515365b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a44b197c3aa0479092f4d77d2c791c39', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:38:14.875335 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8999002f-4d98-475e-8247-154264d57511 service nova] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:38:14.875686 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8999002f-4d98-475e-8247-154264d57511 service nova] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:38:14.875962 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8999002f-4d98-475e-8247-154264d57511 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:38:14.885515 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8999002f-4d98-475e-8247-154264d57511 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:38:14.887187 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8999002f-4d98-475e-8247-154264d57511 service nova] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:38:14.896581 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 493/1003] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Aug 18 19:38:14 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:38:17.269193 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a38db6-ea29-47d8-8fd8-5c01986edca8 None None] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:38:17.269990 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a38db6-ea29-47d8-8fd8-5c01986edca8 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:38:17.269990 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a38db6-ea29-47d8-8fd8-5c01986edca8 None None] PATH_INFO: `/` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:38:17.271086 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 511/1004] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:38:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:38:17.276837 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bc86e1-1005-4109-a759-344b2bbf458d None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:38:17.277292 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bc86e1-1005-4109-a759-344b2bbf458d None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:38:17.277382 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bc86e1-1005-4109-a759-344b2bbf458d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:38:17.297542 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-b0bc86e1-1005-4109-a759-344b2bbf458d None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:38:17.299017 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-b0bc86e1-1005-4109-a759-344b2bbf458d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:38:17.307552 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 494/1005] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:38:17 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:38:17.652807 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a38db6-ea29-47d8-8fd8-5c01986edca8 None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:38:17.667894 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a38db6-ea29-47d8-8fd8-5c01986edca8 None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:38:17.672784 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6872399-fa8b-4e62-b98d-d8aa997d92d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c3560e900d248bc93147ddce515365b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a44b197c3aa0479092f4d77d2c791c39', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:38:17.673494 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6872399-fa8b-4e62-b98d-d8aa997d92d0 service nova] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:38:17.673805 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6872399-fa8b-4e62-b98d-d8aa997d92d0 service nova] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:38:17.674081 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6872399-fa8b-4e62-b98d-d8aa997d92d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:38:17.683209 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6872399-fa8b-4e62-b98d-d8aa997d92d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:38:17.685057 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6872399-fa8b-4e62-b98d-d8aa997d92d0 service nova] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:38:17.694614 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 512/1006] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Aug 18 19:38:17 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:38:19.895979 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65bd2ce-d5c2-42c5-a057-c693b08d95f2 None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:38:19.896656 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65bd2ce-d5c2-42c5-a057-c693b08d95f2 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:38:19.896656 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65bd2ce-d5c2-42c5-a057-c693b08d95f2 None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:38:19.898038 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 495/1007] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:38:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:38:19.903874 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f6932-cff2-4bf0-98b5-2b1141935e14 None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:38:19.904316 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f6932-cff2-4bf0-98b5-2b1141935e14 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:38:19.904573 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f6932-cff2-4bf0-98b5-2b1141935e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:38:19.928888 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-bd2f6932-cff2-4bf0-98b5-2b1141935e14 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:38:19.931213 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-bd2f6932-cff2-4bf0-98b5-2b1141935e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:38:19.941290 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 513/1008] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:38:19 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:38:20.287688 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65bd2ce-d5c2-42c5-a057-c693b08d95f2 None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:38:20.302324 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65bd2ce-d5c2-42c5-a057-c693b08d95f2 None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:38:20.307264 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537c1242-d28d-406e-af6f-665f1670360a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c3560e900d248bc93147ddce515365b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a44b197c3aa0479092f4d77d2c791c39', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:38:20.307872 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537c1242-d28d-406e-af6f-665f1670360a service nova] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:38:20.308166 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537c1242-d28d-406e-af6f-665f1670360a service nova] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:38:20.308439 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537c1242-d28d-406e-af6f-665f1670360a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:38:20.317061 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537c1242-d28d-406e-af6f-665f1670360a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:38:20.318700 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537c1242-d28d-406e-af6f-665f1670360a service nova] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:38:20.329002 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 496/1009] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Aug 18 19:38:20 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:38:23.011169 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af2f4ab-5c75-45cf-84fe-192ad33fb22a None None] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:38:23.036416 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af2f4ab-5c75-45cf-84fe-192ad33fb22a None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:38:23.036416 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af2f4ab-5c75-45cf-84fe-192ad33fb22a None None] PATH_INFO: `/` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:38:23.036416 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 514/1010] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:38:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:38:23.036913 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df74ba3-dc74-4b30-a04b-cc6b772ef795 None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:38:23.036913 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df74ba3-dc74-4b30-a04b-cc6b772ef795 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:38:23.036913 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df74ba3-dc74-4b30-a04b-cc6b772ef795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:38:23.045991 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-2df74ba3-dc74-4b30-a04b-cc6b772ef795 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:38:23.047901 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-2df74ba3-dc74-4b30-a04b-cc6b772ef795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:38:23.057824 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 497/1011] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:38:23 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:38:23.691272 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af2f4ab-5c75-45cf-84fe-192ad33fb22a None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:38:23.705095 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af2f4ab-5c75-45cf-84fe-192ad33fb22a None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:38:23.710658 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f114bf9e-6407-4625-a328-11b3115adfa4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c3560e900d248bc93147ddce515365b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a44b197c3aa0479092f4d77d2c791c39', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:38:23.711272 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f114bf9e-6407-4625-a328-11b3115adfa4 service nova] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:38:23.711549 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f114bf9e-6407-4625-a328-11b3115adfa4 service nova] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:38:23.711824 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f114bf9e-6407-4625-a328-11b3115adfa4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:38:23.720391 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f114bf9e-6407-4625-a328-11b3115adfa4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:38:23.722039 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f114bf9e-6407-4625-a328-11b3115adfa4 service nova] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:38:23.731966 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 515/1012] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Aug 18 19:38:23 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:38:26.567915 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f2afe9-0245-43e9-9d8f-d73f8b78ac2b None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:38:26.568604 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f2afe9-0245-43e9-9d8f-d73f8b78ac2b None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:38:26.568604 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f2afe9-0245-43e9-9d8f-d73f8b78ac2b None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:38:26.569858 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 498/1013] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:38:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:38:26.574976 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb429c8-28ed-4910-8187-b33ca6121a81 None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:38:26.575422 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb429c8-28ed-4910-8187-b33ca6121a81 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:38:26.575523 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb429c8-28ed-4910-8187-b33ca6121a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:38:26.594229 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-1cb429c8-28ed-4910-8187-b33ca6121a81 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:38:26.595417 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-1cb429c8-28ed-4910-8187-b33ca6121a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:38:26.603911 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 516/1014] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:38:26 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:38:26.956518 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f2afe9-0245-43e9-9d8f-d73f8b78ac2b None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:38:26.964515 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=46 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:38:26.971056 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f2afe9-0245-43e9-9d8f-d73f8b78ac2b None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:38:26.976559 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0f13ea-db7e-4d00-9239-07c6ce692960 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c3560e900d248bc93147ddce515365b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a44b197c3aa0479092f4d77d2c791c39', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:38:26.979305 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f13ea-db7e-4d00-9239-07c6ce692960 service nova] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:38:26.979305 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f13ea-db7e-4d00-9239-07c6ce692960 service nova] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:38:26.979305 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f13ea-db7e-4d00-9239-07c6ce692960 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:38:26.986150 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0f13ea-db7e-4d00-9239-07c6ce692960 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:38:26.987738 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0f13ea-db7e-4d00-9239-07c6ce692960 service nova] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:38:26.997067 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 499/1015] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Aug 18 19:38:26 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:38:27.345950 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef88f4d6-645a-43f4-88e1-0d0858d5b3e5 None None] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:38:27.346166 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef88f4d6-645a-43f4-88e1-0d0858d5b3e5 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:38:27.346426 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef88f4d6-645a-43f4-88e1-0d0858d5b3e5 None None] PATH_INFO: `/` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:38:27.347808 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 517/1016] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:38:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:38:27.353185 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f877ff-d46e-4b08-b28e-a45bcce57bfc None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:38:27.353474 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f877ff-d46e-4b08-b28e-a45bcce57bfc None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:38:27.353782 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f877ff-d46e-4b08-b28e-a45bcce57bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:38:27.373047 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-b1f877ff-d46e-4b08-b28e-a45bcce57bfc None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:38:27.374470 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-b1f877ff-d46e-4b08-b28e-a45bcce57bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:38:27.382972 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 500/1017] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:38:27 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:38:27.740413 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987fce23-aca9-48bc-affe-002d276d411e None None] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:38:27.741445 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987fce23-aca9-48bc-affe-002d276d411e None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:38:27.741445 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987fce23-aca9-48bc-affe-002d276d411e None None] PATH_INFO: `/` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:38:27.742826 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 518/1018] 10.222.0.23 () {54 vars in 967 bytes} [Thu Aug 18 19:38:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:38:27.748003 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cfa96f-2688-4809-a59c-e5b97c587dfb None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:38:27.748445 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cfa96f-2688-4809-a59c-e5b97c587dfb None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:38:27.748554 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cfa96f-2688-4809-a59c-e5b97c587dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:38:27.785975 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-86cfa96f-2688-4809-a59c-e5b97c587dfb None None] MFA Rules not processed for user `62ab2be725844b49bde7941867d672d1`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:38:27.787150 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-86cfa96f-2688-4809-a59c-e5b97c587dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:38:27.849791 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 501/1019] 10.222.0.23 () {58 vars in 1064 bytes} [Thu Aug 18 19:38:27 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:38:27.857984 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987fce23-aca9-48bc-affe-002d276d411e None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:38:27.868965 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987fce23-aca9-48bc-affe-002d276d411e None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:38:27.872483 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb19b455-e076-4eea-9103-63d09043731b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62ab2be725844b49bde7941867d672d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a44b197c3aa0479092f4d77d2c791c39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:38:27.873093 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb19b455-e076-4eea-9103-63d09043731b service glance] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:38:27.873371 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb19b455-e076-4eea-9103-63d09043731b service glance] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:38:27.873643 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb19b455-e076-4eea-9103-63d09043731b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:38:27.882654 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb19b455-e076-4eea-9103-63d09043731b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:38:27.884084 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb19b455-e076-4eea-9103-63d09043731b service glance] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:38:27.893548 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 519/1020] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Aug 18 19:38:27 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:38:29.327436 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b1ef6-1297-4c0a-8b37-c5ec5df61189 None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:38:29.328107 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b1ef6-1297-4c0a-8b37-c5ec5df61189 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:38:29.328107 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b1ef6-1297-4c0a-8b37-c5ec5df61189 None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:38:29.329259 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 502/1021] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:38:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:38:29.334713 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa1648-68f4-4088-b28b-bcbcd2091b16 None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:38:29.335259 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa1648-68f4-4088-b28b-bcbcd2091b16 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:38:29.335259 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa1648-68f4-4088-b28b-bcbcd2091b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:38:29.355330 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-41fa1648-68f4-4088-b28b-bcbcd2091b16 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:38:29.360298 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-41fa1648-68f4-4088-b28b-bcbcd2091b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:38:29.364203 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 520/1022] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:38:29 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:38:29.717041 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523b1ef6-1297-4c0a-8b37-c5ec5df61189 None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:38:29.731332 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523b1ef6-1297-4c0a-8b37-c5ec5df61189 None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:38:29.736395 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7b9ab9-652a-4be6-900b-a90e1f74d069 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c3560e900d248bc93147ddce515365b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a44b197c3aa0479092f4d77d2c791c39', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:38:29.737692 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7b9ab9-652a-4be6-900b-a90e1f74d069 service nova] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:38:29.737692 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7b9ab9-652a-4be6-900b-a90e1f74d069 service nova] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:38:29.737692 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7b9ab9-652a-4be6-900b-a90e1f74d069 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:38:29.746290 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7b9ab9-652a-4be6-900b-a90e1f74d069 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:38:29.747861 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7b9ab9-652a-4be6-900b-a90e1f74d069 service nova] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:38:29.758073 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 503/1023] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Aug 18 19:38:29 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:38:32.182259 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4207ff-10c6-46f8-81cd-a4844fc6ba44 None None] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:38:32.182880 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4207ff-10c6-46f8-81cd-a4844fc6ba44 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:38:32.182880 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4207ff-10c6-46f8-81cd-a4844fc6ba44 None None] PATH_INFO: `/` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:38:32.184482 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 521/1024] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:38:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:38:32.189841 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a100727-31f1-4141-be8f-66cb114f3d95 None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:38:32.190377 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a100727-31f1-4141-be8f-66cb114f3d95 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:38:32.190377 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a100727-31f1-4141-be8f-66cb114f3d95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:38:32.210835 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-1a100727-31f1-4141-be8f-66cb114f3d95 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:38:32.211794 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-1a100727-31f1-4141-be8f-66cb114f3d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:38:32.219888 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 504/1025] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:38:32 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 19:38:32.573249 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4207ff-10c6-46f8-81cd-a4844fc6ba44 None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:38:32.587071 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4207ff-10c6-46f8-81cd-a4844fc6ba44 None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:38:32.594345 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24f5f77-3996-4e29-ad07-304d9f64e12f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c3560e900d248bc93147ddce515365b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a44b197c3aa0479092f4d77d2c791c39', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:38:32.597557 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f5f77-3996-4e29-ad07-304d9f64e12f service nova] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:38:32.597557 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f5f77-3996-4e29-ad07-304d9f64e12f service nova] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:38:32.597557 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f5f77-3996-4e29-ad07-304d9f64e12f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:38:32.605045 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24f5f77-3996-4e29-ad07-304d9f64e12f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:38:32.606681 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24f5f77-3996-4e29-ad07-304d9f64e12f service nova] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:38:32.617335 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 522/1026] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Aug 18 19:38:32 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:38:42.205819 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=50 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:38:42.612064 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=37 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:38:43.929295 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f30aeee-432d-4a75-adee-9f3a12d70eb0 None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:38:43.929995 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f30aeee-432d-4a75-adee-9f3a12d70eb0 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:38:43.929995 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f30aeee-432d-4a75-adee-9f3a12d70eb0 None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:38:43.931208 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 505/1027] 10.222.0.23 () {54 vars in 918 bytes} [Thu Aug 18 19:38:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:38:43.936560 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e6e7c9-464c-417a-af8a-4ddc2fc65fc3 None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:38:43.936989 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e6e7c9-464c-417a-af8a-4ddc2fc65fc3 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:38:43.937090 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e6e7c9-464c-417a-af8a-4ddc2fc65fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:38:43.956485 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-89e6e7c9-464c-417a-af8a-4ddc2fc65fc3 None None] MFA Rules not processed for user `b80a74afafd94acd8703fda561e1e4cd`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:38:43.957703 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-89e6e7c9-464c-417a-af8a-4ddc2fc65fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:38:43.966635 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 523/1028] 10.222.0.23 () {58 vars in 1015 bytes} [Thu Aug 18 19:38:43 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:38:43.980403 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1857b228-dcac-4dd8-ad15-388ce75221e7 None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:38:43.980689 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1857b228-dcac-4dd8-ad15-388ce75221e7 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:38:43.980965 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1857b228-dcac-4dd8-ad15-388ce75221e7 None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:38:43.982296 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 506/1029] 10.222.0.23 () {54 vars in 918 bytes} [Thu Aug 18 19:38:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:38:43.986818 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d565fe-7969-490e-97f7-7420880595a5 None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:38:43.987100 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d565fe-7969-490e-97f7-7420880595a5 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:38:43.987371 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d565fe-7969-490e-97f7-7420880595a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:38:44.018429 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-44d565fe-7969-490e-97f7-7420880595a5 None None] MFA Rules not processed for user `9c3560e900d248bc93147ddce515365b`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:38:44.019610 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-44d565fe-7969-490e-97f7-7420880595a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:38:44.027988 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 524/1030] 10.222.0.23 () {58 vars in 1015 bytes} [Thu Aug 18 19:38:43 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:38:46.676074 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d27ea09-4c90-42d4-a55d-a6a656d5dea1 None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:38:46.676616 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d27ea09-4c90-42d4-a55d-a6a656d5dea1 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:38:46.676616 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d27ea09-4c90-42d4-a55d-a6a656d5dea1 None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:38:46.678129 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 507/1031] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 19:38:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:38:46.689270 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4602a9f-018b-4420-adfa-0bb07014674b None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:38:46.689750 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4602a9f-018b-4420-adfa-0bb07014674b None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:38:46.689933 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4602a9f-018b-4420-adfa-0bb07014674b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:38:46.711566 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-e4602a9f-018b-4420-adfa-0bb07014674b None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:38:46.712830 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-e4602a9f-018b-4420-adfa-0bb07014674b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:38:46.720652 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 525/1032] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 19:38:46 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:38:47.058783 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d27ea09-4c90-42d4-a55d-a6a656d5dea1 None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:38:47.076863 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d27ea09-4c90-42d4-a55d-a6a656d5dea1 None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:38:47.077952 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b608de11-b14b-4774-8238-e25e0eebdbe9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c3560e900d248bc93147ddce515365b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a44b197c3aa0479092f4d77d2c791c39', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:38:47.078553 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b608de11-b14b-4774-8238-e25e0eebdbe9 service nova] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:38:47.078833 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b608de11-b14b-4774-8238-e25e0eebdbe9 service nova] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:38:47.079106 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b608de11-b14b-4774-8238-e25e0eebdbe9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:38:47.087251 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b608de11-b14b-4774-8238-e25e0eebdbe9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:38:47.088822 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b608de11-b14b-4774-8238-e25e0eebdbe9 service nova] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:38:47.098369 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 508/1033] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Aug 18 19:38:47 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:38:48.063363 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d35baf4-21c8-4930-9c22-35c9d1b76707 None None] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:38:48.063923 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d35baf4-21c8-4930-9c22-35c9d1b76707 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:38:48.063923 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d35baf4-21c8-4930-9c22-35c9d1b76707 None None] PATH_INFO: `/` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:38:48.065364 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 526/1034] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 19:38:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:38:48.071060 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c9a695-a95f-48b6-b012-212f3de90383 None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:38:48.071485 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c9a695-a95f-48b6-b012-212f3de90383 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:38:48.071609 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c9a695-a95f-48b6-b012-212f3de90383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:38:48.091010 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-c2c9a695-a95f-48b6-b012-212f3de90383 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:38:48.092186 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-c2c9a695-a95f-48b6-b012-212f3de90383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:38:48.099849 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 509/1035] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 19:38:48 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:38:48.283518 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d35baf4-21c8-4930-9c22-35c9d1b76707 None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:38:48.296464 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d35baf4-21c8-4930-9c22-35c9d1b76707 None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:38:48.301205 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e295ce4-9aa6-483b-839c-c94d80a4b760 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c3560e900d248bc93147ddce515365b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a44b197c3aa0479092f4d77d2c791c39', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:38:48.301848 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e295ce4-9aa6-483b-839c-c94d80a4b760 service nova] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:38:48.302124 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e295ce4-9aa6-483b-839c-c94d80a4b760 service nova] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:38:48.302393 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e295ce4-9aa6-483b-839c-c94d80a4b760 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:38:48.310468 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e295ce4-9aa6-483b-839c-c94d80a4b760 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:38:48.312026 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e295ce4-9aa6-483b-839c-c94d80a4b760 service nova] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:38:48.321858 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 527/1036] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Aug 18 19:38:48 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:38:49.210597 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659856e7-a86f-4f64-ad17-4f698b878b30 None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:38:49.211125 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659856e7-a86f-4f64-ad17-4f698b878b30 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:38:49.211125 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659856e7-a86f-4f64-ad17-4f698b878b30 None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:38:49.212489 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 510/1037] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 19:38:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:38:49.217436 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7691a15b-d784-48f3-a9ae-a067d5675c15 None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:38:49.218013 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7691a15b-d784-48f3-a9ae-a067d5675c15 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:38:49.218013 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7691a15b-d784-48f3-a9ae-a067d5675c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:38:49.237519 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-7691a15b-d784-48f3-a9ae-a067d5675c15 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:38:49.238740 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-7691a15b-d784-48f3-a9ae-a067d5675c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:38:49.246826 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 528/1038] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 19:38:49 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:38:49.402799 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659856e7-a86f-4f64-ad17-4f698b878b30 None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:38:49.416075 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659856e7-a86f-4f64-ad17-4f698b878b30 None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:38:49.421901 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26adc57-8ec4-4178-8492-a4dc689d0ed4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c3560e900d248bc93147ddce515365b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a44b197c3aa0479092f4d77d2c791c39', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:38:49.421901 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26adc57-8ec4-4178-8492-a4dc689d0ed4 service nova] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:38:49.421901 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26adc57-8ec4-4178-8492-a4dc689d0ed4 service nova] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:38:49.422212 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26adc57-8ec4-4178-8492-a4dc689d0ed4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:38:49.430861 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26adc57-8ec4-4178-8492-a4dc689d0ed4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:38:49.432437 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26adc57-8ec4-4178-8492-a4dc689d0ed4 service nova] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:38:49.442178 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 511/1039] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Aug 18 19:38:49 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:38:50.312380 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e05606-0a5c-4ae5-b4c5-bc67523be8fc None None] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:38:50.312938 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e05606-0a5c-4ae5-b4c5-bc67523be8fc None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:38:50.312938 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e05606-0a5c-4ae5-b4c5-bc67523be8fc None None] PATH_INFO: `/` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:38:50.314280 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 529/1040] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 19:38:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:38:50.319897 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230c0737-0f08-420d-9606-21b6d4a8d7ca None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:38:50.320298 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230c0737-0f08-420d-9606-21b6d4a8d7ca None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:38:50.320403 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230c0737-0f08-420d-9606-21b6d4a8d7ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:38:50.340147 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-230c0737-0f08-420d-9606-21b6d4a8d7ca None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:38:50.341342 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-230c0737-0f08-420d-9606-21b6d4a8d7ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:38:50.349081 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 512/1041] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 19:38:50 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:38:50.502089 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e05606-0a5c-4ae5-b4c5-bc67523be8fc None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:38:50.515846 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e05606-0a5c-4ae5-b4c5-bc67523be8fc None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:38:50.521411 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2d6f55-2808-4df0-a5e0-d8996c55342b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c3560e900d248bc93147ddce515365b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a44b197c3aa0479092f4d77d2c791c39', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:38:50.522027 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d6f55-2808-4df0-a5e0-d8996c55342b service nova] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:38:50.522305 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d6f55-2808-4df0-a5e0-d8996c55342b service nova] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:38:50.522575 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d6f55-2808-4df0-a5e0-d8996c55342b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:38:50.530441 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2d6f55-2808-4df0-a5e0-d8996c55342b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:38:50.532022 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2d6f55-2808-4df0-a5e0-d8996c55342b service nova] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:38:50.541544 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 530/1042] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Aug 18 19:38:50 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:38:51.401601 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cac59b-fdbc-4fd7-8dc2-905ddd4cae6d None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:38:51.402196 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cac59b-fdbc-4fd7-8dc2-905ddd4cae6d None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:38:51.402296 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cac59b-fdbc-4fd7-8dc2-905ddd4cae6d None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:38:51.403615 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 513/1043] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 19:38:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:38:51.408683 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8633fc-35dd-4ae6-9831-f1f84ee89f2b None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:38:51.409085 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8633fc-35dd-4ae6-9831-f1f84ee89f2b None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:38:51.409216 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8633fc-35dd-4ae6-9831-f1f84ee89f2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:38:51.429258 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-fe8633fc-35dd-4ae6-9831-f1f84ee89f2b None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:38:51.430470 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-fe8633fc-35dd-4ae6-9831-f1f84ee89f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:38:51.438354 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 531/1044] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 19:38:51 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:38:51.591832 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cac59b-fdbc-4fd7-8dc2-905ddd4cae6d None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:38:51.605550 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cac59b-fdbc-4fd7-8dc2-905ddd4cae6d None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:38:51.610444 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda93837-2ca9-4c09-b053-50f3bf9883ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c3560e900d248bc93147ddce515365b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a44b197c3aa0479092f4d77d2c791c39', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:38:51.610995 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda93837-2ca9-4c09-b053-50f3bf9883ef service nova] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:38:51.611270 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda93837-2ca9-4c09-b053-50f3bf9883ef service nova] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:38:51.611540 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda93837-2ca9-4c09-b053-50f3bf9883ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:38:51.619395 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda93837-2ca9-4c09-b053-50f3bf9883ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:38:51.620984 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda93837-2ca9-4c09-b053-50f3bf9883ef service nova] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:38:51.630246 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 514/1045] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Aug 18 19:38:51 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:38:52.506955 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed8942b-44bf-4ea3-962d-237a55c61be0 None None] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:38:52.507450 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed8942b-44bf-4ea3-962d-237a55c61be0 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:38:52.507570 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed8942b-44bf-4ea3-962d-237a55c61be0 None None] PATH_INFO: `/` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:38:52.508858 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 532/1046] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 19:38:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:38:52.513932 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123e46dc-becd-4d24-8e66-94e3873f74da None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:38:52.514336 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123e46dc-becd-4d24-8e66-94e3873f74da None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:38:52.514485 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123e46dc-becd-4d24-8e66-94e3873f74da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:38:52.533446 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-123e46dc-becd-4d24-8e66-94e3873f74da None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:38:52.534694 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-123e46dc-becd-4d24-8e66-94e3873f74da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:38:52.542441 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 515/1047] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 19:38:52 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:38:52.698183 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed8942b-44bf-4ea3-962d-237a55c61be0 None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:38:52.711514 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed8942b-44bf-4ea3-962d-237a55c61be0 None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:38:52.716465 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37f7584-4dbc-4a7b-97b0-9eaf74c818f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c3560e900d248bc93147ddce515365b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a44b197c3aa0479092f4d77d2c791c39', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:38:52.717055 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f7584-4dbc-4a7b-97b0-9eaf74c818f5 service nova] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:38:52.717335 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f7584-4dbc-4a7b-97b0-9eaf74c818f5 service nova] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:38:52.717607 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f7584-4dbc-4a7b-97b0-9eaf74c818f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:38:52.726565 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37f7584-4dbc-4a7b-97b0-9eaf74c818f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:38:52.728124 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37f7584-4dbc-4a7b-97b0-9eaf74c818f5 service nova] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:38:52.737382 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 533/1048] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Aug 18 19:38:52 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:38:53.635399 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14426ec5-26f0-4703-be11-0911f086cdbc None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:38:53.635976 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14426ec5-26f0-4703-be11-0911f086cdbc None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:38:53.635976 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14426ec5-26f0-4703-be11-0911f086cdbc None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:38:53.637325 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 516/1049] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 19:38:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:38:53.642086 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f9017c-99e2-4cf3-867a-f4b005dc87a6 None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:38:53.642465 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f9017c-99e2-4cf3-867a-f4b005dc87a6 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:38:53.642629 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f9017c-99e2-4cf3-867a-f4b005dc87a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:38:53.661931 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-d4f9017c-99e2-4cf3-867a-f4b005dc87a6 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:38:53.663097 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-d4f9017c-99e2-4cf3-867a-f4b005dc87a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:38:53.670729 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 534/1050] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 19:38:53 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:38:53.835473 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14426ec5-26f0-4703-be11-0911f086cdbc None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:38:53.848720 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14426ec5-26f0-4703-be11-0911f086cdbc None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:38:53.853644 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c43bf1c-341c-4a01-8f1e-4713368ebcbf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c3560e900d248bc93147ddce515365b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a44b197c3aa0479092f4d77d2c791c39', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:38:53.854261 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c43bf1c-341c-4a01-8f1e-4713368ebcbf service nova] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:38:53.854544 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c43bf1c-341c-4a01-8f1e-4713368ebcbf service nova] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:38:53.854817 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c43bf1c-341c-4a01-8f1e-4713368ebcbf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:38:53.862794 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c43bf1c-341c-4a01-8f1e-4713368ebcbf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:38:53.864863 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c43bf1c-341c-4a01-8f1e-4713368ebcbf service nova] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:38:53.875273 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 517/1051] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Aug 18 19:38:53 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 19:38:54.743809 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b37b41-92eb-4a2a-9d75-8736a7304ee6 None None] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:38:54.744531 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b37b41-92eb-4a2a-9d75-8736a7304ee6 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:38:54.744531 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b37b41-92eb-4a2a-9d75-8736a7304ee6 None None] PATH_INFO: `/` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:38:54.745705 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 535/1052] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 19:38:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:38:54.750579 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc87e085-545f-4329-b8b3-087af3f81ab8 None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:38:54.751001 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc87e085-545f-4329-b8b3-087af3f81ab8 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:38:54.751138 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc87e085-545f-4329-b8b3-087af3f81ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:38:54.771367 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-bc87e085-545f-4329-b8b3-087af3f81ab8 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:38:54.772568 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-bc87e085-545f-4329-b8b3-087af3f81ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:38:54.780299 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 518/1053] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 19:38:54 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:38:54.936148 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b37b41-92eb-4a2a-9d75-8736a7304ee6 None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:38:54.949535 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b37b41-92eb-4a2a-9d75-8736a7304ee6 None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:38:54.954470 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c013d7a2-cb0c-4944-bc1e-c9e8ced3c76c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c3560e900d248bc93147ddce515365b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a44b197c3aa0479092f4d77d2c791c39', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:38:54.955051 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c013d7a2-cb0c-4944-bc1e-c9e8ced3c76c service nova] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:38:54.957364 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c013d7a2-cb0c-4944-bc1e-c9e8ced3c76c service nova] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:38:54.957364 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c013d7a2-cb0c-4944-bc1e-c9e8ced3c76c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:38:54.963573 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c013d7a2-cb0c-4944-bc1e-c9e8ced3c76c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:38:54.965140 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c013d7a2-cb0c-4944-bc1e-c9e8ced3c76c service nova] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:38:54.974945 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 536/1054] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Aug 18 19:38:54 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:38:55.830719 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab9501d-4a94-4be0-923c-9c5d34f76c4e None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:38:55.831287 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab9501d-4a94-4be0-923c-9c5d34f76c4e None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:38:55.831287 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab9501d-4a94-4be0-923c-9c5d34f76c4e None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:38:55.832587 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 519/1055] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 19:38:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:38:55.837517 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45badb2-2f4c-446b-b5d2-287d6600dce2 None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:38:55.837928 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45badb2-2f4c-446b-b5d2-287d6600dce2 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:38:55.838111 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45badb2-2f4c-446b-b5d2-287d6600dce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:38:55.857824 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-f45badb2-2f4c-446b-b5d2-287d6600dce2 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:38:55.859026 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-f45badb2-2f4c-446b-b5d2-287d6600dce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:38:55.867330 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 537/1056] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 19:38:55 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:38:56.022378 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab9501d-4a94-4be0-923c-9c5d34f76c4e None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:38:56.036486 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab9501d-4a94-4be0-923c-9c5d34f76c4e None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:38:56.041369 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d56464-051c-4b35-9875-7e7fa9f28111 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c3560e900d248bc93147ddce515365b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a44b197c3aa0479092f4d77d2c791c39', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:38:56.046068 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d56464-051c-4b35-9875-7e7fa9f28111 service nova] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:38:56.046068 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d56464-051c-4b35-9875-7e7fa9f28111 service nova] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:38:56.046068 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d56464-051c-4b35-9875-7e7fa9f28111 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:38:56.050686 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d56464-051c-4b35-9875-7e7fa9f28111 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:38:56.052273 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d56464-051c-4b35-9875-7e7fa9f28111 service nova] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:38:56.062165 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 520/1057] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Aug 18 19:38:56 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 19:38:58.213574 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b44a73-798c-4b0a-8ca6-65026ee757ef None None] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:38:58.214150 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b44a73-798c-4b0a-8ca6-65026ee757ef None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:38:58.214150 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b44a73-798c-4b0a-8ca6-65026ee757ef None None] PATH_INFO: `/` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:38:58.215463 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 538/1058] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 19:38:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:38:58.220827 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227614e1-3cfb-4c18-ae58-0fe4b99fa977 None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:38:58.221209 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227614e1-3cfb-4c18-ae58-0fe4b99fa977 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:38:58.221369 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227614e1-3cfb-4c18-ae58-0fe4b99fa977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:38:58.240692 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-227614e1-3cfb-4c18-ae58-0fe4b99fa977 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:38:58.241887 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-227614e1-3cfb-4c18-ae58-0fe4b99fa977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:38:58.249790 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 521/1059] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 19:38:58 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:38:58.586568 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b44a73-798c-4b0a-8ca6-65026ee757ef None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:38:58.597286 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b44a73-798c-4b0a-8ca6-65026ee757ef None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:38:58.601277 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9370e2fc-af93-4cd6-81c3-d7a4b58ba506 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '516923ce386f459190af3fd7eaa81551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a44b197c3aa0479092f4d77d2c791c39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:38:58.601905 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9370e2fc-af93-4cd6-81c3-d7a4b58ba506 service neutron] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:38:58.602180 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9370e2fc-af93-4cd6-81c3-d7a4b58ba506 service neutron] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:38:58.602444 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9370e2fc-af93-4cd6-81c3-d7a4b58ba506 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:38:58.611174 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9370e2fc-af93-4cd6-81c3-d7a4b58ba506 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:38:58.612593 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9370e2fc-af93-4cd6-81c3-d7a4b58ba506 service neutron] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:38:58.622305 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 539/1060] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Aug 18 19:38:58 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:39:00.931031 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495e9218-9d15-4180-99a7-99602aee65ae None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:39:00.931587 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495e9218-9d15-4180-99a7-99602aee65ae None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:39:00.931587 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495e9218-9d15-4180-99a7-99602aee65ae None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:39:00.933163 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 522/1061] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 19:39:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:39:00.938460 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab24783-ed02-45bf-be76-5c345d48f74b None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:39:00.938873 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab24783-ed02-45bf-be76-5c345d48f74b None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:39:00.939004 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab24783-ed02-45bf-be76-5c345d48f74b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:39:00.957685 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-3ab24783-ed02-45bf-be76-5c345d48f74b None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:39:00.958852 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-3ab24783-ed02-45bf-be76-5c345d48f74b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:39:00.966394 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 540/1062] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 19:39:00 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:39:01.303561 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495e9218-9d15-4180-99a7-99602aee65ae None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:39:01.314521 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495e9218-9d15-4180-99a7-99602aee65ae None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:39:01.317986 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efedc6b1-fe23-4ddd-a679-2dcf7a62f70b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '516923ce386f459190af3fd7eaa81551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a44b197c3aa0479092f4d77d2c791c39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:39:01.319984 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efedc6b1-fe23-4ddd-a679-2dcf7a62f70b service neutron] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:39:01.319984 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efedc6b1-fe23-4ddd-a679-2dcf7a62f70b service neutron] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:39:01.319984 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efedc6b1-fe23-4ddd-a679-2dcf7a62f70b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:39:01.327788 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efedc6b1-fe23-4ddd-a679-2dcf7a62f70b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:39:01.329207 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efedc6b1-fe23-4ddd-a679-2dcf7a62f70b service neutron] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:39:01.339236 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 523/1063] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Aug 18 19:39:01 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:39:03.836190 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e7d9ca-93c1-406e-9806-2c491aad5416 None None] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:39:03.836738 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e7d9ca-93c1-406e-9806-2c491aad5416 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:39:03.836738 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e7d9ca-93c1-406e-9806-2c491aad5416 None None] PATH_INFO: `/` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:39:03.838093 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 541/1064] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 19:39:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:39:03.843314 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76516a2-e5d5-441c-8e51-b4d799d2fea0 None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:39:03.843749 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76516a2-e5d5-441c-8e51-b4d799d2fea0 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:39:03.843897 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76516a2-e5d5-441c-8e51-b4d799d2fea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:39:03.862968 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-d76516a2-e5d5-441c-8e51-b4d799d2fea0 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:39:03.864156 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-d76516a2-e5d5-441c-8e51-b4d799d2fea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:39:03.871922 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 524/1065] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 19:39:03 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:39:04.217157 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e7d9ca-93c1-406e-9806-2c491aad5416 None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:39:04.227694 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e7d9ca-93c1-406e-9806-2c491aad5416 None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:39:04.231164 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9114b9b6-9799-4d09-8bf7-78c0cff9b24f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '516923ce386f459190af3fd7eaa81551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a44b197c3aa0479092f4d77d2c791c39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:39:04.231748 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9114b9b6-9799-4d09-8bf7-78c0cff9b24f service neutron] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:39:04.232028 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9114b9b6-9799-4d09-8bf7-78c0cff9b24f service neutron] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:39:04.232299 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9114b9b6-9799-4d09-8bf7-78c0cff9b24f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:39:04.241532 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9114b9b6-9799-4d09-8bf7-78c0cff9b24f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:39:04.242981 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9114b9b6-9799-4d09-8bf7-78c0cff9b24f service neutron] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:39:04.252106 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 542/1066] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Aug 18 19:39:04 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:39:06.535550 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5423890-8eb6-4f79-b854-fb8d0235ed79 None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:39:06.536132 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5423890-8eb6-4f79-b854-fb8d0235ed79 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:39:06.536132 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5423890-8eb6-4f79-b854-fb8d0235ed79 None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:39:06.537412 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 525/1067] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 19:39:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:39:06.542555 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe4442a-f18b-408d-a930-f4de485ed578 None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:39:06.542943 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe4442a-f18b-408d-a930-f4de485ed578 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:39:06.543096 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe4442a-f18b-408d-a930-f4de485ed578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:39:06.561909 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-afe4442a-f18b-408d-a930-f4de485ed578 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:39:06.563078 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-afe4442a-f18b-408d-a930-f4de485ed578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:39:06.571080 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 543/1068] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 19:39:06 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:39:06.914064 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5423890-8eb6-4f79-b854-fb8d0235ed79 None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:39:06.924631 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5423890-8eb6-4f79-b854-fb8d0235ed79 None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:39:06.928166 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3495ec1e-e9a0-4763-81ac-b2de0918f1a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '516923ce386f459190af3fd7eaa81551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a44b197c3aa0479092f4d77d2c791c39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:39:06.928762 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3495ec1e-e9a0-4763-81ac-b2de0918f1a5 service neutron] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:39:06.929041 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3495ec1e-e9a0-4763-81ac-b2de0918f1a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:39:06.929309 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3495ec1e-e9a0-4763-81ac-b2de0918f1a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:39:06.938264 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3495ec1e-e9a0-4763-81ac-b2de0918f1a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:39:06.939675 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3495ec1e-e9a0-4763-81ac-b2de0918f1a5 service neutron] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:39:06.949516 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 526/1069] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Aug 18 19:39:06 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:39:09.252052 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04fbebd-da13-4807-85e8-9e09a751d737 None None] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:39:09.252604 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04fbebd-da13-4807-85e8-9e09a751d737 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:39:09.252604 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04fbebd-da13-4807-85e8-9e09a751d737 None None] PATH_INFO: `/` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:39:09.254508 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 544/1070] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 19:39:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:39:09.259761 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68896989-288b-422e-aea7-dad9b0f92646 None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:39:09.260132 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68896989-288b-422e-aea7-dad9b0f92646 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:39:09.260310 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68896989-288b-422e-aea7-dad9b0f92646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:39:09.279803 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-68896989-288b-422e-aea7-dad9b0f92646 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:39:09.280980 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-68896989-288b-422e-aea7-dad9b0f92646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:39:09.288601 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 527/1071] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 19:39:09 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:39:09.629003 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04fbebd-da13-4807-85e8-9e09a751d737 None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:39:09.639925 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04fbebd-da13-4807-85e8-9e09a751d737 None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:39:09.643395 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35466458-de84-4a65-9290-41164691772e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '516923ce386f459190af3fd7eaa81551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a44b197c3aa0479092f4d77d2c791c39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:39:09.644494 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35466458-de84-4a65-9290-41164691772e service neutron] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:39:09.644767 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35466458-de84-4a65-9290-41164691772e service neutron] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:39:09.645032 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35466458-de84-4a65-9290-41164691772e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:39:09.653815 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35466458-de84-4a65-9290-41164691772e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:39:09.655241 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35466458-de84-4a65-9290-41164691772e service neutron] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:39:09.665458 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 545/1072] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Aug 18 19:39:09 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:39:11.968356 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2588e8-98bc-410f-8029-9ece6996f74e None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:39:11.968920 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2588e8-98bc-410f-8029-9ece6996f74e None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:39:11.968920 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2588e8-98bc-410f-8029-9ece6996f74e None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:39:11.970426 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 528/1073] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 19:39:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:39:11.976036 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03988844-e7d0-4b33-af18-8b504c92b7bd None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:39:11.976833 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03988844-e7d0-4b33-af18-8b504c92b7bd None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:39:11.977303 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03988844-e7d0-4b33-af18-8b504c92b7bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:39:11.997016 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-03988844-e7d0-4b33-af18-8b504c92b7bd None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:39:11.998242 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-03988844-e7d0-4b33-af18-8b504c92b7bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:39:12.006107 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 546/1074] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 19:39:11 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:39:12.343974 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2588e8-98bc-410f-8029-9ece6996f74e None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:39:12.350031 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=64 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:39:12.355453 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2588e8-98bc-410f-8029-9ece6996f74e None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:39:12.358931 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438fb6e8-4b15-452f-ae9a-e4724af0a317 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '516923ce386f459190af3fd7eaa81551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a44b197c3aa0479092f4d77d2c791c39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:39:12.363718 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438fb6e8-4b15-452f-ae9a-e4724af0a317 service neutron] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:39:12.363718 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438fb6e8-4b15-452f-ae9a-e4724af0a317 service neutron] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:39:12.363718 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438fb6e8-4b15-452f-ae9a-e4724af0a317 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:39:12.369467 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438fb6e8-4b15-452f-ae9a-e4724af0a317 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:39:12.370995 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438fb6e8-4b15-452f-ae9a-e4724af0a317 service neutron] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:39:12.380242 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 529/1075] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Aug 18 19:39:12 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:39:14.597137 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c5d94-e676-47dc-bc90-0099969bc89c None None] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:39:14.597740 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c5d94-e676-47dc-bc90-0099969bc89c None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:39:14.597740 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c5d94-e676-47dc-bc90-0099969bc89c None None] PATH_INFO: `/` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:39:14.599022 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 547/1076] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 19:39:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:39:14.604151 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db2f94a-b5a7-48aa-8010-db2af6e706cc None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:39:14.604571 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db2f94a-b5a7-48aa-8010-db2af6e706cc None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:39:14.604697 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db2f94a-b5a7-48aa-8010-db2af6e706cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:39:14.623833 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-7db2f94a-b5a7-48aa-8010-db2af6e706cc None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:39:14.625020 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-7db2f94a-b5a7-48aa-8010-db2af6e706cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:39:14.632564 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 530/1077] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 19:39:14 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:39:14.968577 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1c5d94-e676-47dc-bc90-0099969bc89c None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:39:14.973902 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=78 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:39:14.979481 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1c5d94-e676-47dc-bc90-0099969bc89c None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:39:14.982937 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e861b0-7d65-49f9-b259-917fe92bbb58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '516923ce386f459190af3fd7eaa81551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a44b197c3aa0479092f4d77d2c791c39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:39:14.984614 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e861b0-7d65-49f9-b259-917fe92bbb58 service neutron] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:39:14.984614 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e861b0-7d65-49f9-b259-917fe92bbb58 service neutron] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:39:14.984614 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e861b0-7d65-49f9-b259-917fe92bbb58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:39:14.993379 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e861b0-7d65-49f9-b259-917fe92bbb58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:39:14.994862 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e861b0-7d65-49f9-b259-917fe92bbb58 service neutron] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:39:15.005351 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 548/1078] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Aug 18 19:39:14 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:39:17.219751 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b120a50-9fa6-4be2-be4e-b97ee78a37be None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:39:17.220330 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b120a50-9fa6-4be2-be4e-b97ee78a37be None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:39:17.220330 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b120a50-9fa6-4be2-be4e-b97ee78a37be None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:39:17.222340 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 531/1079] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 19:39:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:39:17.227636 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f00423b-298f-41b0-ad0a-88c419df128e None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:39:17.228074 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f00423b-298f-41b0-ad0a-88c419df128e None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:39:17.228225 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f00423b-298f-41b0-ad0a-88c419df128e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:39:17.247398 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-4f00423b-298f-41b0-ad0a-88c419df128e None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:39:17.248578 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-4f00423b-298f-41b0-ad0a-88c419df128e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:39:17.256335 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 549/1080] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 19:39:17 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:39:17.602472 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b120a50-9fa6-4be2-be4e-b97ee78a37be None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:39:17.613206 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b120a50-9fa6-4be2-be4e-b97ee78a37be None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:39:17.616645 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72774465-d067-4c09-8118-f83348ec7872 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '516923ce386f459190af3fd7eaa81551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a44b197c3aa0479092f4d77d2c791c39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:39:17.617228 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72774465-d067-4c09-8118-f83348ec7872 service neutron] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:39:17.617502 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72774465-d067-4c09-8118-f83348ec7872 service neutron] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:39:17.617808 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72774465-d067-4c09-8118-f83348ec7872 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:39:17.627734 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72774465-d067-4c09-8118-f83348ec7872 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:39:17.629225 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72774465-d067-4c09-8118-f83348ec7872 service neutron] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:39:17.638822 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 532/1081] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Aug 18 19:39:17 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:39:19.820280 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa586d-8c71-4ed3-9c60-f2997f405873 None None] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:39:19.820840 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa586d-8c71-4ed3-9c60-f2997f405873 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:39:19.820840 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa586d-8c71-4ed3-9c60-f2997f405873 None None] PATH_INFO: `/` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:39:19.822209 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 550/1082] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 19:39:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:39:19.827312 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0fc2bf-d455-44f9-808b-24a2b9d2a8fe None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:39:19.827725 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0fc2bf-d455-44f9-808b-24a2b9d2a8fe None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:39:19.827889 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0fc2bf-d455-44f9-808b-24a2b9d2a8fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:39:19.847228 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-9f0fc2bf-d455-44f9-808b-24a2b9d2a8fe None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:39:19.848422 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-9f0fc2bf-d455-44f9-808b-24a2b9d2a8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:39:19.856102 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 533/1083] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 19:39:19 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:39:20.194943 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aa586d-8c71-4ed3-9c60-f2997f405873 None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:39:20.205519 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aa586d-8c71-4ed3-9c60-f2997f405873 None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:39:20.208975 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025104bc-ed5c-4cab-aa4f-f517d5a02560 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '516923ce386f459190af3fd7eaa81551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a44b197c3aa0479092f4d77d2c791c39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:39:20.209563 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025104bc-ed5c-4cab-aa4f-f517d5a02560 service neutron] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:39:20.209880 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025104bc-ed5c-4cab-aa4f-f517d5a02560 service neutron] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:39:20.210159 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025104bc-ed5c-4cab-aa4f-f517d5a02560 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:39:20.218857 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025104bc-ed5c-4cab-aa4f-f517d5a02560 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:39:20.220281 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025104bc-ed5c-4cab-aa4f-f517d5a02560 service neutron] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:39:20.229593 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 551/1084] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Aug 18 19:39:20 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:39:22.406202 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17245d28-4842-4b21-b2f5-bcc08f76c22e None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:39:22.406734 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17245d28-4842-4b21-b2f5-bcc08f76c22e None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:39:22.406841 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17245d28-4842-4b21-b2f5-bcc08f76c22e None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:39:22.408710 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 534/1085] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 19:39:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:39:22.413789 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c480958a-507f-4c23-a51f-96f4f4916634 None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:39:22.414235 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c480958a-507f-4c23-a51f-96f4f4916634 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:39:22.414344 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c480958a-507f-4c23-a51f-96f4f4916634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:39:22.433355 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-c480958a-507f-4c23-a51f-96f4f4916634 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:39:22.434575 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-c480958a-507f-4c23-a51f-96f4f4916634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:39:22.442261 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 552/1086] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 19:39:22 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:39:22.778964 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17245d28-4842-4b21-b2f5-bcc08f76c22e None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:39:22.789583 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17245d28-4842-4b21-b2f5-bcc08f76c22e None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:39:22.793064 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002b5e96-ea85-4182-a09a-e33550ba2e06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '516923ce386f459190af3fd7eaa81551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a44b197c3aa0479092f4d77d2c791c39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:39:22.793683 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b5e96-ea85-4182-a09a-e33550ba2e06 service neutron] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:39:22.793953 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b5e96-ea85-4182-a09a-e33550ba2e06 service neutron] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:39:22.794223 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b5e96-ea85-4182-a09a-e33550ba2e06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:39:22.802953 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002b5e96-ea85-4182-a09a-e33550ba2e06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:39:22.804435 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002b5e96-ea85-4182-a09a-e33550ba2e06 service neutron] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:39:22.813788 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 535/1087] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Aug 18 19:39:22 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:39:32.428351 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=17 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:39:32.809896 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=23 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:39:46.559524 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db3cdeb-166b-4dd3-b2c9-f65b00c7e005 None None] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:39:46.560145 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db3cdeb-166b-4dd3-b2c9-f65b00c7e005 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:39:46.560145 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db3cdeb-166b-4dd3-b2c9-f65b00c7e005 None None] PATH_INFO: `/` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:39:46.561387 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 553/1088] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:39:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:39:46.567180 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3160f6d-89a7-4e8c-9316-1fb82473befb None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:39:46.567604 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3160f6d-89a7-4e8c-9316-1fb82473befb None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:39:46.567708 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3160f6d-89a7-4e8c-9316-1fb82473befb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:39:46.586243 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-f3160f6d-89a7-4e8c-9316-1fb82473befb None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:39:46.587421 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-f3160f6d-89a7-4e8c-9316-1fb82473befb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:39:46.595511 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 536/1089] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:39:46 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:39:46.945509 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b3ca0a-149e-438f-bb4e-76e8fe04624c None None] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:39:46.945835 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b3ca0a-149e-438f-bb4e-76e8fe04624c None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:39:46.946115 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b3ca0a-149e-438f-bb4e-76e8fe04624c None None] PATH_INFO: `/` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:39:46.947427 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 554/1090] 10.222.0.23 () {54 vars in 967 bytes} [Thu Aug 18 19:39:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:39:46.952558 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8de684e-55d5-4193-ad10-d09037bb5640 None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:39:46.952844 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8de684e-55d5-4193-ad10-d09037bb5640 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:39:46.953647 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8de684e-55d5-4193-ad10-d09037bb5640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:39:46.984016 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-e8de684e-55d5-4193-ad10-d09037bb5640 None None] MFA Rules not processed for user `62ab2be725844b49bde7941867d672d1`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:39:46.985214 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-e8de684e-55d5-4193-ad10-d09037bb5640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:39:46.991454 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 537/1091] 10.222.0.23 () {58 vars in 1064 bytes} [Thu Aug 18 19:39:46 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:39:46.998636 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b3ca0a-149e-438f-bb4e-76e8fe04624c None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:39:47.009216 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b3ca0a-149e-438f-bb4e-76e8fe04624c None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:39:47.012667 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0e20cf-a765-4245-8e5d-3b5a812f8322 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62ab2be725844b49bde7941867d672d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a44b197c3aa0479092f4d77d2c791c39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:39:47.013248 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e20cf-a765-4245-8e5d-3b5a812f8322 service glance] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:39:47.013526 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e20cf-a765-4245-8e5d-3b5a812f8322 service glance] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:39:47.013839 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e20cf-a765-4245-8e5d-3b5a812f8322 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:39:47.022966 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0e20cf-a765-4245-8e5d-3b5a812f8322 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:39:47.024420 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0e20cf-a765-4245-8e5d-3b5a812f8322 service glance] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:39:47.034389 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 555/1092] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Aug 18 19:39:46 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 19:39:49.281898 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eedf5c-f3ae-4a88-a8ad-272e644560af None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:39:49.282452 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eedf5c-f3ae-4a88-a8ad-272e644560af None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:39:49.282452 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eedf5c-f3ae-4a88-a8ad-272e644560af None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:39:49.283838 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 538/1093] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:39:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:39:49.288847 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9ebcb9-2d36-4006-9b28-350c3a0f37e6 None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:39:49.289300 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9ebcb9-2d36-4006-9b28-350c3a0f37e6 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:39:49.289408 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9ebcb9-2d36-4006-9b28-350c3a0f37e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:39:49.309076 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-bd9ebcb9-2d36-4006-9b28-350c3a0f37e6 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:39:49.310305 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-bd9ebcb9-2d36-4006-9b28-350c3a0f37e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:39:49.318609 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 556/1094] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:39:49 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:39:49.646410 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eedf5c-f3ae-4a88-a8ad-272e644560af None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:39:49.659504 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eedf5c-f3ae-4a88-a8ad-272e644560af None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:39:49.663978 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20ffd20-151d-4c69-bcd5-9397b96ff1c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df56ebe1a05047a7a4d05174a8a4c7f1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:39:49.664575 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ffd20-151d-4c69-bcd5-9397b96ff1c8 admin admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:39:49.664859 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ffd20-151d-4c69-bcd5-9397b96ff1c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:39:49.665161 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ffd20-151d-4c69-bcd5-9397b96ff1c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:39:49.665846 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20ffd20-151d-4c69-bcd5-9397b96ff1c8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:39:49.667586 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: WARNING py.warnings [None req-a20ffd20-151d-4c69-bcd5-9397b96ff1c8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 19:39:49.667586 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: warnings.warn(msg) Aug 18 19:39:49.667586 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: Aug 18 19:39:49.668750 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20ffd20-151d-4c69-bcd5-9397b96ff1c8 admin admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:39:49.688061 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 539/1095] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Aug 18 19:39:49 2022] GET /identity/v3/projects => generated 1606 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 19:39:51.859402 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a0ca1-2064-4039-902f-e12f74cfd31a None None] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:39:51.859970 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a0ca1-2064-4039-902f-e12f74cfd31a None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:39:51.859970 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a0ca1-2064-4039-902f-e12f74cfd31a None None] PATH_INFO: `/` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:39:51.861287 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 557/1096] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:39:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:39:51.866297 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad04816a-24d5-4f29-88a2-feec8cd3c1c2 None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:39:51.866707 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad04816a-24d5-4f29-88a2-feec8cd3c1c2 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:39:51.866847 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad04816a-24d5-4f29-88a2-feec8cd3c1c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:39:51.886553 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-ad04816a-24d5-4f29-88a2-feec8cd3c1c2 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:39:51.887734 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-ad04816a-24d5-4f29-88a2-feec8cd3c1c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:39:51.896244 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 540/1097] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:39:51 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:39:52.243449 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4a0ca1-2064-4039-902f-e12f74cfd31a None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:39:52.257355 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4a0ca1-2064-4039-902f-e12f74cfd31a None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:39:52.262204 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90b814c-46c9-4b05-85c3-c22f216e4cfc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c3560e900d248bc93147ddce515365b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a44b197c3aa0479092f4d77d2c791c39', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:39:52.262788 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b814c-46c9-4b05-85c3-c22f216e4cfc service nova] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:39:52.263067 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b814c-46c9-4b05-85c3-c22f216e4cfc service nova] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:39:52.263340 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b814c-46c9-4b05-85c3-c22f216e4cfc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:39:52.271276 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90b814c-46c9-4b05-85c3-c22f216e4cfc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:39:52.272857 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90b814c-46c9-4b05-85c3-c22f216e4cfc service nova] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:39:52.282537 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 558/1098] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Aug 18 19:39:52 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:39:54.624344 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceeab42-fb61-4261-9713-4fc9291e5b67 None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:39:54.624909 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceeab42-fb61-4261-9713-4fc9291e5b67 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:39:54.624909 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceeab42-fb61-4261-9713-4fc9291e5b67 None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:39:54.626346 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 541/1099] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:39:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:39:54.631301 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eda2a2f-f892-4c29-b0c1-d70ea22ef6a9 None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:39:54.631750 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eda2a2f-f892-4c29-b0c1-d70ea22ef6a9 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:39:54.631846 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eda2a2f-f892-4c29-b0c1-d70ea22ef6a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:39:54.651039 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-0eda2a2f-f892-4c29-b0c1-d70ea22ef6a9 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:39:54.652235 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-0eda2a2f-f892-4c29-b0c1-d70ea22ef6a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:39:54.660609 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 559/1100] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:39:54 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:39:55.001870 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceeab42-fb61-4261-9713-4fc9291e5b67 None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:39:55.012431 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceeab42-fb61-4261-9713-4fc9291e5b67 None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:39:55.016587 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11d4e8b-7cd5-4d0f-8c17-79688f073eb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '516923ce386f459190af3fd7eaa81551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a44b197c3aa0479092f4d77d2c791c39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:39:55.017182 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11d4e8b-7cd5-4d0f-8c17-79688f073eb8 service neutron] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:39:55.017459 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11d4e8b-7cd5-4d0f-8c17-79688f073eb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:39:55.017771 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11d4e8b-7cd5-4d0f-8c17-79688f073eb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:39:55.026483 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11d4e8b-7cd5-4d0f-8c17-79688f073eb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:39:55.027912 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11d4e8b-7cd5-4d0f-8c17-79688f073eb8 service neutron] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:39:55.037204 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 542/1101] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Aug 18 19:39:55 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:39:57.297456 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89361738-b2fb-4733-b456-45e7511e461f None None] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:39:57.298058 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89361738-b2fb-4733-b456-45e7511e461f None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:39:57.298058 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89361738-b2fb-4733-b456-45e7511e461f None None] PATH_INFO: `/` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:39:57.299408 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 560/1102] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:39:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:39:57.304784 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b010f-64e7-47ed-898e-3066b9293f81 None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:39:57.305513 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b010f-64e7-47ed-898e-3066b9293f81 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:39:57.305611 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b010f-64e7-47ed-898e-3066b9293f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:39:57.325406 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-1b2b010f-64e7-47ed-898e-3066b9293f81 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:39:57.326569 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-1b2b010f-64e7-47ed-898e-3066b9293f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:39:57.335632 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 543/1103] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:39:57 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:39:57.681327 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89361738-b2fb-4733-b456-45e7511e461f None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:39:57.692481 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89361738-b2fb-4733-b456-45e7511e461f None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:39:57.695984 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb5bb98-71a4-4d4f-bcf9-25f0dbd89d60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '516923ce386f459190af3fd7eaa81551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a44b197c3aa0479092f4d77d2c791c39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:39:57.696568 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb5bb98-71a4-4d4f-bcf9-25f0dbd89d60 service neutron] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:39:57.696849 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb5bb98-71a4-4d4f-bcf9-25f0dbd89d60 service neutron] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:39:57.697124 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb5bb98-71a4-4d4f-bcf9-25f0dbd89d60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:39:57.705877 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb5bb98-71a4-4d4f-bcf9-25f0dbd89d60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:39:57.707302 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb5bb98-71a4-4d4f-bcf9-25f0dbd89d60 service neutron] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:39:57.716442 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 561/1104] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Aug 18 19:39:57 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:39:59.963654 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0224354e-21cb-4829-a288-e90b1f45a2fd None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:39:59.964233 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0224354e-21cb-4829-a288-e90b1f45a2fd None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:39:59.964233 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0224354e-21cb-4829-a288-e90b1f45a2fd None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:39:59.965566 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 544/1105] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:39:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:39:59.970775 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed12f5-cdb5-4f5d-8d1d-058269357497 None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:39:59.971235 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed12f5-cdb5-4f5d-8d1d-058269357497 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:39:59.971345 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed12f5-cdb5-4f5d-8d1d-058269357497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:39:59.992023 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-6eed12f5-cdb5-4f5d-8d1d-058269357497 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:39:59.993222 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-6eed12f5-cdb5-4f5d-8d1d-058269357497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:40:00.001481 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 562/1106] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:39:59 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:40:00.352132 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0224354e-21cb-4829-a288-e90b1f45a2fd None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:40:00.363449 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0224354e-21cb-4829-a288-e90b1f45a2fd None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:40:00.366924 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8552e518-6e4a-4fe6-9364-e86dabae2f3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '516923ce386f459190af3fd7eaa81551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a44b197c3aa0479092f4d77d2c791c39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:40:00.367609 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8552e518-6e4a-4fe6-9364-e86dabae2f3e service neutron] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:40:00.367909 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8552e518-6e4a-4fe6-9364-e86dabae2f3e service neutron] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:40:00.368213 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8552e518-6e4a-4fe6-9364-e86dabae2f3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:40:00.376839 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8552e518-6e4a-4fe6-9364-e86dabae2f3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:40:00.378297 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8552e518-6e4a-4fe6-9364-e86dabae2f3e service neutron] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:40:00.392181 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 545/1107] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Aug 18 19:40:00 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:40:03.012278 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aed3f6-8906-4b2f-a643-101e8b28c9bd None None] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:40:03.012774 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aed3f6-8906-4b2f-a643-101e8b28c9bd None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:40:03.012883 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aed3f6-8906-4b2f-a643-101e8b28c9bd None None] PATH_INFO: `/` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:40:03.014201 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 563/1108] 10.222.0.23 () {54 vars in 927 bytes} [Thu Aug 18 19:40:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 19:40:03.019383 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f9b99-51b9-4d9a-bb5a-0ad7edcd237e None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:40:03.019798 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f9b99-51b9-4d9a-bb5a-0ad7edcd237e None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:40:03.019935 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f9b99-51b9-4d9a-bb5a-0ad7edcd237e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:40:03.038749 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-111f9b99-51b9-4d9a-bb5a-0ad7edcd237e None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:40:03.039968 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-111f9b99-51b9-4d9a-bb5a-0ad7edcd237e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:40:03.048222 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 546/1109] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Aug 18 19:40:03 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:40:03.391247 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aed3f6-8906-4b2f-a643-101e8b28c9bd None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:40:03.401787 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aed3f6-8906-4b2f-a643-101e8b28c9bd None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:40:03.405783 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac64a70-f4b2-46a9-9e0b-53532b74f8cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '516923ce386f459190af3fd7eaa81551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a44b197c3aa0479092f4d77d2c791c39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:40:03.407985 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac64a70-f4b2-46a9-9e0b-53532b74f8cb service neutron] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:40:03.407985 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac64a70-f4b2-46a9-9e0b-53532b74f8cb service neutron] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:40:03.407985 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac64a70-f4b2-46a9-9e0b-53532b74f8cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:40:03.415601 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac64a70-f4b2-46a9-9e0b-53532b74f8cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:40:03.417023 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac64a70-f4b2-46a9-9e0b-53532b74f8cb service neutron] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:40:03.426831 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 564/1110] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Aug 18 19:40:03 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:40:13.033789 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=38 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:40:13.422769 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=33 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:41:32.566000 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00af0787-e9dd-455e-b053-77c1af66e819 None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:41:32.566579 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00af0787-e9dd-455e-b053-77c1af66e819 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:41:32.566579 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00af0787-e9dd-455e-b053-77c1af66e819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:41:32.586945 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-00af0787-e9dd-455e-b053-77c1af66e819 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:41:32.595432 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-00af0787-e9dd-455e-b053-77c1af66e819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:41:32.595729 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 547/1111] 10.222.0.23 () {58 vars in 958 bytes} [Thu Aug 18 19:41:32 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:41:32.604349 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd4e1e-4562-4f5a-a997-7466cea659c5 None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:41:32.604844 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd4e1e-4562-4f5a-a997-7466cea659c5 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:41:32.604941 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd4e1e-4562-4f5a-a997-7466cea659c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:41:32.623893 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-02cd4e1e-4562-4f5a-a997-7466cea659c5 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:41:32.625098 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-02cd4e1e-4562-4f5a-a997-7466cea659c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:41:32.632830 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 565/1112] 10.222.0.23 () {58 vars in 958 bytes} [Thu Aug 18 19:41:32 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:41:32.637395 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00af0787-e9dd-455e-b053-77c1af66e819 None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:41:32.647610 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00af0787-e9dd-455e-b053-77c1af66e819 None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:41:32.652684 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c36c21f-275a-4ecd-9d33-01df2c4f3f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df56ebe1a05047a7a4d05174a8a4c7f1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:41:32.653313 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c36c21f-275a-4ecd-9d33-01df2c4f3f0b admin admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:41:32.653592 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c36c21f-275a-4ecd-9d33-01df2c4f3f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:41:32.653901 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c36c21f-275a-4ecd-9d33-01df2c4f3f0b admin admin] PATH_INFO: `/v3/domains` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:41:32.654535 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c36c21f-275a-4ecd-9d33-01df2c4f3f0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:41:32.654838 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c36c21f-275a-4ecd-9d33-01df2c4f3f0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:41:32.655837 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: WARNING py.warnings [None req-0c36c21f-275a-4ecd-9d33-01df2c4f3f0b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 19:41:32.655837 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: warnings.warn(msg) Aug 18 19:41:32.655837 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: Aug 18 19:41:32.656740 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c36c21f-275a-4ecd-9d33-01df2c4f3f0b admin admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:41:32.668943 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 548/1113] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Aug 18 19:41:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:41:32.677528 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cd4e1e-4562-4f5a-a997-7466cea659c5 None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:41:32.686492 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cd4e1e-4562-4f5a-a997-7466cea659c5 None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:41:32.691036 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154c9843-ae2d-4689-bec8-368d9a229819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df56ebe1a05047a7a4d05174a8a4c7f1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:41:32.691622 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c9843-ae2d-4689-bec8-368d9a229819 admin admin] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:41:32.691897 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c9843-ae2d-4689-bec8-368d9a229819 admin admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:41:32.692164 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c9843-ae2d-4689-bec8-368d9a229819 admin admin] PATH_INFO: `/v3/projects` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:41:32.692768 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154c9843-ae2d-4689-bec8-368d9a229819 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:41:32.694496 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: WARNING py.warnings [None req-154c9843-ae2d-4689-bec8-368d9a229819 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 19:41:32.694496 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: warnings.warn(msg) Aug 18 19:41:32.694496 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: Aug 18 19:41:32.696197 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154c9843-ae2d-4689-bec8-368d9a229819 admin admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:41:32.785145 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 566/1114] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Aug 18 19:41:32 2022] POST /identity/v3/projects => generated 377 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 19:41:32.789765 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c36c21f-275a-4ecd-9d33-01df2c4f3f0b admin admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:41:32.799623 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c36c21f-275a-4ecd-9d33-01df2c4f3f0b admin admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:41:32.855022 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045e0584-43a8-4de2-8ec8-5cf7e2d5fe4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df56ebe1a05047a7a4d05174a8a4c7f1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:41:32.855621 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045e0584-43a8-4de2-8ec8-5cf7e2d5fe4c admin admin] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:41:32.855903 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045e0584-43a8-4de2-8ec8-5cf7e2d5fe4c admin admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:41:32.856174 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045e0584-43a8-4de2-8ec8-5cf7e2d5fe4c admin admin] PATH_INFO: `/v3/users` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:41:32.856793 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045e0584-43a8-4de2-8ec8-5cf7e2d5fe4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:41:32.857828 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: WARNING py.warnings [None req-045e0584-43a8-4de2-8ec8-5cf7e2d5fe4c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 19:41:32.857828 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: warnings.warn(msg) Aug 18 19:41:32.857828 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: Aug 18 19:41:32.859039 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045e0584-43a8-4de2-8ec8-5cf7e2d5fe4c admin admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:41:32.962172 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 549/1115] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Aug 18 19:41:32 2022] POST /identity/v3/users => generated 289 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 19:41:32.966313 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154c9843-ae2d-4689-bec8-368d9a229819 admin admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:41:32.976657 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154c9843-ae2d-4689-bec8-368d9a229819 admin admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:41:32.981319 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fb3448-f171-44a4-a019-22a5080e51f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df56ebe1a05047a7a4d05174a8a4c7f1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:41:32.981951 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fb3448-f171-44a4-a019-22a5080e51f4 admin admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:41:32.982232 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fb3448-f171-44a4-a019-22a5080e51f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:41:32.982502 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fb3448-f171-44a4-a019-22a5080e51f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:41:32.983216 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fb3448-f171-44a4-a019-22a5080e51f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:41:32.984232 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: WARNING py.warnings [None req-e1fb3448-f171-44a4-a019-22a5080e51f4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 19:41:32.984232 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: warnings.warn(msg) Aug 18 19:41:32.984232 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: Aug 18 19:41:32.985105 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fb3448-f171-44a4-a019-22a5080e51f4 admin admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:41:32.997823 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 567/1116] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Aug 18 19:41:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 19:41:33.001731 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045e0584-43a8-4de2-8ec8-5cf7e2d5fe4c admin admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:41:33.012229 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045e0584-43a8-4de2-8ec8-5cf7e2d5fe4c admin admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:41:33.016929 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e09c30f-3075-480b-ab73-7eaabc03ce17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df56ebe1a05047a7a4d05174a8a4c7f1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:41:33.019892 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e09c30f-3075-480b-ab73-7eaabc03ce17 admin admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:41:33.019892 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e09c30f-3075-480b-ab73-7eaabc03ce17 admin admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:41:33.019892 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e09c30f-3075-480b-ab73-7eaabc03ce17 admin admin] PATH_INFO: `/v3/roles` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:41:33.019892 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e09c30f-3075-480b-ab73-7eaabc03ce17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:41:33.019892 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: WARNING py.warnings [None req-0e09c30f-3075-480b-ab73-7eaabc03ce17 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 19:41:33.019892 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: warnings.warn(msg) Aug 18 19:41:33.019892 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: Aug 18 19:41:33.020728 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e09c30f-3075-480b-ab73-7eaabc03ce17 admin admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:41:33.034603 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 550/1117] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Aug 18 19:41:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 19:41:33.038791 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fb3448-f171-44a4-a019-22a5080e51f4 admin admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:41:33.048654 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fb3448-f171-44a4-a019-22a5080e51f4 admin admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:41:33.053613 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9db61d-7768-43ed-8a42-06f6f1558903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df56ebe1a05047a7a4d05174a8a4c7f1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:41:33.054262 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9db61d-7768-43ed-8a42-06f6f1558903 admin admin] REQUEST_METHOD: `PUT` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:41:33.054546 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9db61d-7768-43ed-8a42-06f6f1558903 admin admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:41:33.055328 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9db61d-7768-43ed-8a42-06f6f1558903 admin admin] PATH_INFO: `/v3/projects/365ad8c73c4a4619b205dcc408be05e8/users/f5cda13539354afa89bd06dcfe4a8bc6/roles/ece5eb2bd1334192b3eee1b7b05c042c` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:41:33.071443 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9db61d-7768-43ed-8a42-06f6f1558903 admin admin] RBAC: Authorizing `identity:create_grant(project_id=365ad8c73c4a4619b205dcc408be05e8, user_id=f5cda13539354afa89bd06dcfe4a8bc6, role_id=ece5eb2bd1334192b3eee1b7b05c042c)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:41:33.072477 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: WARNING py.warnings [None req-1a9db61d-7768-43ed-8a42-06f6f1558903 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 19:41:33.072477 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: warnings.warn(msg) Aug 18 19:41:33.072477 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: Aug 18 19:41:33.074471 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9db61d-7768-43ed-8a42-06f6f1558903 admin admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:41:33.186614 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 568/1118] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Aug 18 19:41:33 2022] PUT /identity/v3/projects/365ad8c73c4a4619b205dcc408be05e8/users/f5cda13539354afa89bd06dcfe4a8bc6/roles/ece5eb2bd1334192b3eee1b7b05c042c => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 19:41:33.199553 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc0e03-32e3-4ca8-b6a7-6493b8bb11dd None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:41:33.199838 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc0e03-32e3-4ca8-b6a7-6493b8bb11dd None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:41:33.200112 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc0e03-32e3-4ca8-b6a7-6493b8bb11dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:41:33.226720 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-66bc0e03-32e3-4ca8-b6a7-6493b8bb11dd None None] MFA Rules not processed for user `f5cda13539354afa89bd06dcfe4a8bc6`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:41:33.227900 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-66bc0e03-32e3-4ca8-b6a7-6493b8bb11dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:41:33.289485 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 551/1119] 10.222.0.23 () {58 vars in 958 bytes} [Thu Aug 18 19:41:33 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:41:33.302662 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222443ea-c540-4f23-9165-18a914d7f7b9 None None] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:41:33.302955 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222443ea-c540-4f23-9165-18a914d7f7b9 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:41:33.303264 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222443ea-c540-4f23-9165-18a914d7f7b9 None None] PATH_INFO: `/` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:41:33.304580 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 569/1120] 10.222.0.23 () {54 vars in 964 bytes} [Thu Aug 18 19:41:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:41:33.310051 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb271d3-61aa-45c0-b2d6-ef7f22a6bc75 None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:41:33.310335 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb271d3-61aa-45c0-b2d6-ef7f22a6bc75 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:41:33.310605 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb271d3-61aa-45c0-b2d6-ef7f22a6bc75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:41:33.342306 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-afb271d3-61aa-45c0-b2d6-ef7f22a6bc75 None None] MFA Rules not processed for user `28c99ca9206340269f30be592fcd3f75`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:41:33.343481 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-afb271d3-61aa-45c0-b2d6-ef7f22a6bc75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:41:33.374982 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:41:33.393623 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 552/1121] 10.222.0.23 () {58 vars in 1061 bytes} [Thu Aug 18 19:41:33 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:41:33.401325 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222443ea-c540-4f23-9165-18a914d7f7b9 None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:41:33.411907 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222443ea-c540-4f23-9165-18a914d7f7b9 None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:41:33.416093 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab6f55d-223b-4a6c-bcaa-57ca7f82789c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28c99ca9206340269f30be592fcd3f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a44b197c3aa0479092f4d77d2c791c39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:41:33.416693 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab6f55d-223b-4a6c-bcaa-57ca7f82789c service cinder] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:41:33.416970 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab6f55d-223b-4a6c-bcaa-57ca7f82789c service cinder] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:41:33.417239 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab6f55d-223b-4a6c-bcaa-57ca7f82789c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:41:33.425532 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab6f55d-223b-4a6c-bcaa-57ca7f82789c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:41:33.427254 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab6f55d-223b-4a6c-bcaa-57ca7f82789c service cinder] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:41:33.436409 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 570/1122] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Aug 18 19:41:33 2022] GET /identity/v3/auth/tokens => generated 2814 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:41:33.472855 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794a62a3-00b1-4e85-9c86-9dcf53371622 None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:41:33.473149 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794a62a3-00b1-4e85-9c86-9dcf53371622 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:41:33.473427 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794a62a3-00b1-4e85-9c86-9dcf53371622 None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:41:33.474748 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 553/1123] 10.222.0.23 () {52 vars in 830 bytes} [Thu Aug 18 19:41:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:41:33.478819 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab6f55d-223b-4a6c-bcaa-57ca7f82789c service cinder] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:41:33.539650 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab6f55d-223b-4a6c-bcaa-57ca7f82789c service cinder] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:41:33.544247 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb007996-9cf4-4c88-bbe6-4501d6130539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df56ebe1a05047a7a4d05174a8a4c7f1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:41:33.546441 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb007996-9cf4-4c88-bbe6-4501d6130539 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:41:33.546441 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb007996-9cf4-4c88-bbe6-4501d6130539 admin admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:41:33.546441 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb007996-9cf4-4c88-bbe6-4501d6130539 admin admin] PATH_INFO: `/v3/users/f5cda13539354afa89bd06dcfe4a8bc6` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:41:33.546741 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb007996-9cf4-4c88-bbe6-4501d6130539 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5cda13539354afa89bd06dcfe4a8bc6)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:41:33.547545 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: WARNING py.warnings [None req-cb007996-9cf4-4c88-bbe6-4501d6130539 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 19:41:33.547545 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: warnings.warn(msg) Aug 18 19:41:33.547545 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: Aug 18 19:41:33.548745 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb007996-9cf4-4c88-bbe6-4501d6130539 admin admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:41:33.744690 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.notifications [None req-cb007996-9cf4-4c88-bbe6-4501d6130539 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5cda13539354afa89bd06dcfe4a8bc6'} {{(pid=88470) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 19:41:33.803551 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.notifications [None req-cb007996-9cf4-4c88-bbe6-4501d6130539 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5cda13539354afa89bd06dcfe4a8bc6'} {{(pid=88470) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 19:41:33.826047 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.notifications [None req-cb007996-9cf4-4c88-bbe6-4501d6130539 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5cda13539354afa89bd06dcfe4a8bc6'} {{(pid=88470) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 19:41:33.826894 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.notifications [None req-cb007996-9cf4-4c88-bbe6-4501d6130539 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5cda13539354afa89bd06dcfe4a8bc6'} {{(pid=88470) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 19:41:33.837358 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:41:33.841569 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.notifications [None req-cb007996-9cf4-4c88-bbe6-4501d6130539 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5cda13539354afa89bd06dcfe4a8bc6'} {{(pid=88470) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 19:41:33.847411 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 571/1124] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Aug 18 19:41:33 2022] DELETE /identity/v3/users/f5cda13539354afa89bd06dcfe4a8bc6 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 19:41:33.852627 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4039b41c-ba57-4ef6-bc99-e85ba8e9a215 None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:41:33.853102 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4039b41c-ba57-4ef6-bc99-e85ba8e9a215 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:41:33.853206 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4039b41c-ba57-4ef6-bc99-e85ba8e9a215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:41:33.871351 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-4039b41c-ba57-4ef6-bc99-e85ba8e9a215 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:41:33.872535 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-4039b41c-ba57-4ef6-bc99-e85ba8e9a215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:41:33.930432 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 554/1125] 10.222.0.23 () {58 vars in 958 bytes} [Thu Aug 18 19:41:33 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:41:33.939808 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb007996-9cf4-4c88-bbe6-4501d6130539 admin admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:41:33.941179 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-cb007996-9cf4-4c88-bbe6-4501d6130539 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:41:34.009181 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb007996-9cf4-4c88-bbe6-4501d6130539 admin admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:41:34.012733 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d125a3-ef00-4201-b8a2-da61aece763e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '516923ce386f459190af3fd7eaa81551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a44b197c3aa0479092f4d77d2c791c39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:41:34.013330 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d125a3-ef00-4201-b8a2-da61aece763e service neutron] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:41:34.013605 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d125a3-ef00-4201-b8a2-da61aece763e service neutron] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:41:34.013905 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d125a3-ef00-4201-b8a2-da61aece763e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:41:34.022506 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d125a3-ef00-4201-b8a2-da61aece763e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:41:34.024436 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d125a3-ef00-4201-b8a2-da61aece763e service neutron] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:41:34.033587 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 572/1126] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Aug 18 19:41:33 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:41:34.500865 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4039b41c-ba57-4ef6-bc99-e85ba8e9a215 None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:41:34.502500 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-4039b41c-ba57-4ef6-bc99-e85ba8e9a215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:41:34.514941 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4039b41c-ba57-4ef6-bc99-e85ba8e9a215 None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:41:34.520836 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3523ec68-85ec-4d06-a6cc-9e3dedea8255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df56ebe1a05047a7a4d05174a8a4c7f1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:41:34.521473 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3523ec68-85ec-4d06-a6cc-9e3dedea8255 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:41:34.521787 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3523ec68-85ec-4d06-a6cc-9e3dedea8255 admin admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:41:34.522065 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3523ec68-85ec-4d06-a6cc-9e3dedea8255 admin admin] PATH_INFO: `/v3/projects/365ad8c73c4a4619b205dcc408be05e8` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:41:34.523174 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3523ec68-85ec-4d06-a6cc-9e3dedea8255 admin admin] RBAC: Authorizing `identity:delete_project(project_id=365ad8c73c4a4619b205dcc408be05e8)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:41:34.525399 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: WARNING py.warnings [None req-3523ec68-85ec-4d06-a6cc-9e3dedea8255 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 19:41:34.525399 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: warnings.warn(msg) Aug 18 19:41:34.525399 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: Aug 18 19:41:34.526844 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3523ec68-85ec-4d06-a6cc-9e3dedea8255 admin admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:41:34.652822 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.notifications [None req-3523ec68-85ec-4d06-a6cc-9e3dedea8255 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '365ad8c73c4a4619b205dcc408be05e8', 'request_id': 'req-3523ec68-85ec-4d06-a6cc-9e3dedea8255'} {{(pid=88471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 19:41:34.727347 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.notifications [None req-3523ec68-85ec-4d06-a6cc-9e3dedea8255 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '365ad8c73c4a4619b205dcc408be05e8', 'request_id': 'req-3523ec68-85ec-4d06-a6cc-9e3dedea8255'} {{(pid=88471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 19:41:34.733573 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.notifications [None req-3523ec68-85ec-4d06-a6cc-9e3dedea8255 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '365ad8c73c4a4619b205dcc408be05e8', 'request_id': 'req-3523ec68-85ec-4d06-a6cc-9e3dedea8255'} {{(pid=88471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 19:41:34.753515 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.notifications [None req-3523ec68-85ec-4d06-a6cc-9e3dedea8255 admin admin] The token cache is being invalidate because project 365ad8c73c4a4619b205dcc408be05e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88471) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 19:41:34.753901 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.notifications [None req-3523ec68-85ec-4d06-a6cc-9e3dedea8255 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 19:41:34.754552 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.notifications [None req-3523ec68-85ec-4d06-a6cc-9e3dedea8255 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 19:41:34.756122 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 555/1127] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 18 19:41:34 2022] DELETE /identity/v3/projects/365ad8c73c4a4619b205dcc408be05e8 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 19:41:44.029585 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=34 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:41:44.750621 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=60,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:42:56.015361 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3047c4d-2ed3-4bb3-af3d-38a1d23b5d10 None None] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:42:56.015972 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3047c4d-2ed3-4bb3-af3d-38a1d23b5d10 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:42:56.015972 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3047c4d-2ed3-4bb3-af3d-38a1d23b5d10 None None] PATH_INFO: `/` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:42:56.017232 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 573/1128] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 19:42:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:42:56.022088 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c2a823-c1c3-4e66-ac7b-485bd0e47b0c None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:42:56.022504 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c2a823-c1c3-4e66-ac7b-485bd0e47b0c None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:42:56.022629 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c2a823-c1c3-4e66-ac7b-485bd0e47b0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:42:56.042049 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-27c2a823-c1c3-4e66-ac7b-485bd0e47b0c None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:42:56.043242 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-27c2a823-c1c3-4e66-ac7b-485bd0e47b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:42:56.100833 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 556/1129] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 19:42:56 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:42:56.262744 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3047c4d-2ed3-4bb3-af3d-38a1d23b5d10 None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:42:56.264459 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-a3047c4d-2ed3-4bb3-af3d-38a1d23b5d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:42:56.333968 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3047c4d-2ed3-4bb3-af3d-38a1d23b5d10 None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:42:56.339316 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ae2629-3ac0-4ffc-9878-bea125fae2e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c3560e900d248bc93147ddce515365b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a44b197c3aa0479092f4d77d2c791c39', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:42:56.339914 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ae2629-3ac0-4ffc-9878-bea125fae2e2 service nova] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:42:56.340193 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ae2629-3ac0-4ffc-9878-bea125fae2e2 service nova] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:42:56.340470 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ae2629-3ac0-4ffc-9878-bea125fae2e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:42:56.348362 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ae2629-3ac0-4ffc-9878-bea125fae2e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:42:56.349976 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ae2629-3ac0-4ffc-9878-bea125fae2e2 service nova] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:42:56.359794 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 574/1130] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Aug 18 19:42:56 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:42:57.190026 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a39133b-abc9-45cd-8899-5d8ccfdd9b45 None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:42:57.190569 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a39133b-abc9-45cd-8899-5d8ccfdd9b45 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:42:57.190569 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a39133b-abc9-45cd-8899-5d8ccfdd9b45 None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:42:57.191931 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 557/1131] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 19:42:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:42:57.197265 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824f709a-b65d-498c-b4db-146c83f0f1fb None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:42:57.197748 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824f709a-b65d-498c-b4db-146c83f0f1fb None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:42:57.197854 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824f709a-b65d-498c-b4db-146c83f0f1fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:42:57.218841 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-824f709a-b65d-498c-b4db-146c83f0f1fb None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:42:57.220016 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-824f709a-b65d-498c-b4db-146c83f0f1fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:42:57.228177 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 575/1132] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 19:42:57 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:42:57.385225 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a39133b-abc9-45cd-8899-5d8ccfdd9b45 None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:42:57.398279 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a39133b-abc9-45cd-8899-5d8ccfdd9b45 None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:42:57.403135 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9777603a-c5ba-44e3-b5e3-9e7b74c6e103 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c3560e900d248bc93147ddce515365b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a44b197c3aa0479092f4d77d2c791c39', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:42:57.403726 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9777603a-c5ba-44e3-b5e3-9e7b74c6e103 service nova] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:42:57.404002 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9777603a-c5ba-44e3-b5e3-9e7b74c6e103 service nova] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:42:57.404273 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9777603a-c5ba-44e3-b5e3-9e7b74c6e103 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:42:57.412076 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9777603a-c5ba-44e3-b5e3-9e7b74c6e103 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:42:57.413632 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9777603a-c5ba-44e3-b5e3-9e7b74c6e103 service nova] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:42:57.423436 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 558/1133] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Aug 18 19:42:57 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:43:02.334459 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce2fdfd-e914-4410-80e2-4b03e2c6dedc None None] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:43:02.334995 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce2fdfd-e914-4410-80e2-4b03e2c6dedc None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:43:02.334995 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce2fdfd-e914-4410-80e2-4b03e2c6dedc None None] PATH_INFO: `/v3` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:43:02.336319 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 576/1134] 10.222.0.50 () {54 vars in 925 bytes} [Thu Aug 18 19:43:02 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:43:02.342616 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9ba272-e4ad-490f-987c-ba896d58b9dc None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:43:02.343016 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9ba272-e4ad-490f-987c-ba896d58b9dc None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:43:02.343309 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9ba272-e4ad-490f-987c-ba896d58b9dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:43:02.374679 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-fc9ba272-e4ad-490f-987c-ba896d58b9dc None None] MFA Rules not processed for user `b80a74afafd94acd8703fda561e1e4cd`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:43:02.375881 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-fc9ba272-e4ad-490f-987c-ba896d58b9dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:43:02.437597 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 559/1135] 10.222.0.50 () {58 vars in 1015 bytes} [Thu Aug 18 19:43:02 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:43:07.214127 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=35 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:43:08.639253 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed90d56-e936-4f0c-a32f-bf35cf9b4a56 None None] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:43:08.639920 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed90d56-e936-4f0c-a32f-bf35cf9b4a56 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:43:08.639920 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed90d56-e936-4f0c-a32f-bf35cf9b4a56 None None] PATH_INFO: `/` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:43:08.641138 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 577/1136] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 19:43:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:43:08.645828 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0464b891-c840-428f-9468-b1476937059c None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:43:08.646212 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0464b891-c840-428f-9468-b1476937059c None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:43:08.646391 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0464b891-c840-428f-9468-b1476937059c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:43:08.666040 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-0464b891-c840-428f-9468-b1476937059c None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:43:08.667234 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-0464b891-c840-428f-9468-b1476937059c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:43:08.675209 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 560/1137] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 19:43:08 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:43:08.834605 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed90d56-e936-4f0c-a32f-bf35cf9b4a56 None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:43:08.849020 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed90d56-e936-4f0c-a32f-bf35cf9b4a56 None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:43:08.854162 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5c7520-1809-4d20-832c-9373f53784a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c3560e900d248bc93147ddce515365b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a44b197c3aa0479092f4d77d2c791c39', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:43:08.854750 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5c7520-1809-4d20-832c-9373f53784a3 service nova] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:43:08.855025 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5c7520-1809-4d20-832c-9373f53784a3 service nova] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:43:08.855290 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5c7520-1809-4d20-832c-9373f53784a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:43:08.863341 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5c7520-1809-4d20-832c-9373f53784a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:43:08.865019 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5c7520-1809-4d20-832c-9373f53784a3 service nova] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:43:08.874916 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 578/1138] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Aug 18 19:43:08 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:43:09.709811 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65b744c-fb32-4edd-a59e-2a79a4e2e0c9 None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:43:09.710430 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65b744c-fb32-4edd-a59e-2a79a4e2e0c9 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:43:09.710430 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65b744c-fb32-4edd-a59e-2a79a4e2e0c9 None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:43:09.711895 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 561/1139] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 19:43:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:43:09.716527 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65381750-d71e-4fb0-9621-7934d1585852 None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:43:09.716977 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65381750-d71e-4fb0-9621-7934d1585852 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:43:09.717085 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65381750-d71e-4fb0-9621-7934d1585852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:43:09.735886 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-65381750-d71e-4fb0-9621-7934d1585852 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:43:09.737063 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-65381750-d71e-4fb0-9621-7934d1585852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:43:09.745347 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 579/1140] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 19:43:09 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:43:09.902636 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65b744c-fb32-4edd-a59e-2a79a4e2e0c9 None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:43:09.916664 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65b744c-fb32-4edd-a59e-2a79a4e2e0c9 None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:43:09.922641 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8124e0c4-078b-4dbf-ab0b-fe88b0343b23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c3560e900d248bc93147ddce515365b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a44b197c3aa0479092f4d77d2c791c39', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:43:09.923252 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8124e0c4-078b-4dbf-ab0b-fe88b0343b23 service nova] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:43:09.923531 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8124e0c4-078b-4dbf-ab0b-fe88b0343b23 service nova] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:43:09.923802 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8124e0c4-078b-4dbf-ab0b-fe88b0343b23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:43:09.932142 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8124e0c4-078b-4dbf-ab0b-fe88b0343b23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:43:09.933799 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8124e0c4-078b-4dbf-ab0b-fe88b0343b23 service nova] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:43:09.943093 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 562/1141] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Aug 18 19:43:09 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:43:12.126781 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c97a51-d0b1-486a-bc5d-c65b968b26ef None None] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:43:12.127277 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c97a51-d0b1-486a-bc5d-c65b968b26ef None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:43:12.127384 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c97a51-d0b1-486a-bc5d-c65b968b26ef None None] PATH_INFO: `/` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:43:12.128629 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 580/1142] 10.222.0.23 () {54 vars in 961 bytes} [Thu Aug 18 19:43:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:43:12.133461 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4305ba2-9f7c-4b9d-a148-33e82783216e None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:43:12.133953 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4305ba2-9f7c-4b9d-a148-33e82783216e None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:43:12.134093 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4305ba2-9f7c-4b9d-a148-33e82783216e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:43:12.153466 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-a4305ba2-9f7c-4b9d-a148-33e82783216e None None] MFA Rules not processed for user `b80a74afafd94acd8703fda561e1e4cd`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:43:12.154687 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-a4305ba2-9f7c-4b9d-a148-33e82783216e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:43:12.163241 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 563/1143] 10.222.0.23 () {58 vars in 1058 bytes} [Thu Aug 18 19:43:12 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 19:43:12.170865 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c97a51-d0b1-486a-bc5d-c65b968b26ef None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:43:12.183935 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c97a51-d0b1-486a-bc5d-c65b968b26ef None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:43:12.188714 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd377dab-4594-4323-8861-dd57b6be86a6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b80a74afafd94acd8703fda561e1e4cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a44b197c3aa0479092f4d77d2c791c39', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:43:12.189292 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd377dab-4594-4323-8861-dd57b6be86a6 service placement] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:43:12.189565 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd377dab-4594-4323-8861-dd57b6be86a6 service placement] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:43:12.189862 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd377dab-4594-4323-8861-dd57b6be86a6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:43:12.197821 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd377dab-4594-4323-8861-dd57b6be86a6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:43:12.199394 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd377dab-4594-4323-8861-dd57b6be86a6 service placement] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:43:12.208549 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 581/1144] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Aug 18 19:43:12 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:43:21.152440 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c3e67f-ce97-4bf9-82fd-cce1fb3fd066 None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:43:21.152964 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c3e67f-ce97-4bf9-82fd-cce1fb3fd066 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:43:21.153087 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c3e67f-ce97-4bf9-82fd-cce1fb3fd066 None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:43:21.154380 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 564/1145] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 19:43:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:43:21.159014 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54de1b4-11f1-4e56-bf17-f66bb18dcad4 None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:43:21.159514 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54de1b4-11f1-4e56-bf17-f66bb18dcad4 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:43:21.159615 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54de1b4-11f1-4e56-bf17-f66bb18dcad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:43:21.179230 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-a54de1b4-11f1-4e56-bf17-f66bb18dcad4 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:43:21.180405 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-a54de1b4-11f1-4e56-bf17-f66bb18dcad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:43:21.188018 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 582/1146] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 19:43:21 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:43:21.344961 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c3e67f-ce97-4bf9-82fd-cce1fb3fd066 None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:43:21.360061 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c3e67f-ce97-4bf9-82fd-cce1fb3fd066 None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:43:21.365237 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0437adc6-3ce3-4642-a4d7-775465c57da4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c3560e900d248bc93147ddce515365b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a44b197c3aa0479092f4d77d2c791c39', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:43:21.365890 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0437adc6-3ce3-4642-a4d7-775465c57da4 service nova] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:43:21.366173 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0437adc6-3ce3-4642-a4d7-775465c57da4 service nova] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:43:21.366445 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0437adc6-3ce3-4642-a4d7-775465c57da4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:43:21.374711 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0437adc6-3ce3-4642-a4d7-775465c57da4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:43:21.380366 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0437adc6-3ce3-4642-a4d7-775465c57da4 service nova] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:43:21.386166 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 565/1147] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Aug 18 19:43:21 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:43:22.213364 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf7c03c-5717-4511-96be-ac6143c4e34a None None] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:43:22.213982 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf7c03c-5717-4511-96be-ac6143c4e34a None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:43:22.213982 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf7c03c-5717-4511-96be-ac6143c4e34a None None] PATH_INFO: `/` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:43:22.215255 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 583/1148] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 19:43:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:43:22.220021 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda5599f-5acf-41de-b7bf-67f29d2db388 None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:43:22.220415 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda5599f-5acf-41de-b7bf-67f29d2db388 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:43:22.220562 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda5599f-5acf-41de-b7bf-67f29d2db388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:43:22.239317 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-bda5599f-5acf-41de-b7bf-67f29d2db388 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:43:22.240490 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-bda5599f-5acf-41de-b7bf-67f29d2db388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:43:22.248759 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 566/1149] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 19:43:22 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:43:22.416196 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf7c03c-5717-4511-96be-ac6143c4e34a None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:43:22.430426 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf7c03c-5717-4511-96be-ac6143c4e34a None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:43:22.435277 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97601ad2-9f47-4a7c-a0df-efa8cf079427 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c3560e900d248bc93147ddce515365b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a44b197c3aa0479092f4d77d2c791c39', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:43:22.435863 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97601ad2-9f47-4a7c-a0df-efa8cf079427 service nova] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:43:22.436140 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97601ad2-9f47-4a7c-a0df-efa8cf079427 service nova] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:43:22.436412 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97601ad2-9f47-4a7c-a0df-efa8cf079427 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:43:22.444889 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97601ad2-9f47-4a7c-a0df-efa8cf079427 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:43:22.446499 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97601ad2-9f47-4a7c-a0df-efa8cf079427 service nova] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:43:22.455630 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 584/1150] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Aug 18 19:43:22 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:43:26.699080 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f358ba-3ca4-49a8-8cd1-e5eba830ffa7 None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:43:26.699663 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f358ba-3ca4-49a8-8cd1-e5eba830ffa7 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:43:26.699663 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f358ba-3ca4-49a8-8cd1-e5eba830ffa7 None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:43:26.700961 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 567/1151] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 19:43:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:43:26.706088 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35235928-9014-4249-bb80-23964561fb9d None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:43:26.706530 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35235928-9014-4249-bb80-23964561fb9d None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:43:26.706670 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35235928-9014-4249-bb80-23964561fb9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:43:26.726129 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-35235928-9014-4249-bb80-23964561fb9d None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:43:26.727310 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-35235928-9014-4249-bb80-23964561fb9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:43:26.735072 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 585/1152] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 19:43:26 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:43:27.076860 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f358ba-3ca4-49a8-8cd1-e5eba830ffa7 None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:43:27.078580 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-23f358ba-3ca4-49a8-8cd1-e5eba830ffa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:43:27.084811 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=89 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:43:27.136793 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f358ba-3ca4-49a8-8cd1-e5eba830ffa7 None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:43:27.140245 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d6bf75-2957-4807-b617-b7145d8399f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '516923ce386f459190af3fd7eaa81551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a44b197c3aa0479092f4d77d2c791c39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:43:27.140844 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d6bf75-2957-4807-b617-b7145d8399f3 service neutron] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:43:27.141122 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d6bf75-2957-4807-b617-b7145d8399f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:43:27.141393 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d6bf75-2957-4807-b617-b7145d8399f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:43:27.150519 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d6bf75-2957-4807-b617-b7145d8399f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:43:27.151933 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d6bf75-2957-4807-b617-b7145d8399f3 service neutron] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:43:27.160971 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 568/1153] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Aug 18 19:43:27 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:43:29.295105 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3735e646-7f60-4afe-aea4-f5a46e975407 None None] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:43:29.295863 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3735e646-7f60-4afe-aea4-f5a46e975407 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:43:29.295967 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3735e646-7f60-4afe-aea4-f5a46e975407 None None] PATH_INFO: `/` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:43:29.297243 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 586/1154] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 19:43:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:43:29.302256 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6194313e-ae2b-4366-9948-92f30888194b None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:43:29.303206 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6194313e-ae2b-4366-9948-92f30888194b None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:43:29.303343 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6194313e-ae2b-4366-9948-92f30888194b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:43:29.323002 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-6194313e-ae2b-4366-9948-92f30888194b None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:43:29.324141 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-6194313e-ae2b-4366-9948-92f30888194b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:43:29.331719 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 569/1155] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 19:43:29 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:43:29.685961 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3735e646-7f60-4afe-aea4-f5a46e975407 None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:43:29.697147 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3735e646-7f60-4afe-aea4-f5a46e975407 None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:43:29.700642 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413c6370-15eb-421d-91d5-39479fc79395 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '516923ce386f459190af3fd7eaa81551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a44b197c3aa0479092f4d77d2c791c39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:43:29.701232 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c6370-15eb-421d-91d5-39479fc79395 service neutron] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:43:29.701511 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c6370-15eb-421d-91d5-39479fc79395 service neutron] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:43:29.701826 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c6370-15eb-421d-91d5-39479fc79395 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:43:29.711222 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413c6370-15eb-421d-91d5-39479fc79395 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:43:29.712645 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413c6370-15eb-421d-91d5-39479fc79395 service neutron] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:43:29.722117 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 587/1156] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Aug 18 19:43:29 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:43:33.511969 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea608cd2-d5e5-4959-b264-fbd54eba2a4c None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:43:33.512529 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea608cd2-d5e5-4959-b264-fbd54eba2a4c None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:43:33.512529 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea608cd2-d5e5-4959-b264-fbd54eba2a4c None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:43:33.513884 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 570/1157] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 19:43:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:43:33.518961 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc659d65-0439-4fa2-8b63-de5af5e6b31e None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:43:33.519357 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc659d65-0439-4fa2-8b63-de5af5e6b31e None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:43:33.519501 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc659d65-0439-4fa2-8b63-de5af5e6b31e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:43:33.539004 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-cc659d65-0439-4fa2-8b63-de5af5e6b31e None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:43:33.540211 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-cc659d65-0439-4fa2-8b63-de5af5e6b31e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:43:33.548110 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 588/1158] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 19:43:33 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:43:34.140293 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea608cd2-d5e5-4959-b264-fbd54eba2a4c None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:43:34.142015 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-ea608cd2-d5e5-4959-b264-fbd54eba2a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:43:34.199386 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea608cd2-d5e5-4959-b264-fbd54eba2a4c None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:43:34.202919 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18ca837-9c26-425f-990c-1331d68a0f77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28c99ca9206340269f30be592fcd3f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a44b197c3aa0479092f4d77d2c791c39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:43:34.203520 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18ca837-9c26-425f-990c-1331d68a0f77 service cinder] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:43:34.203802 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18ca837-9c26-425f-990c-1331d68a0f77 service cinder] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:43:34.204078 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18ca837-9c26-425f-990c-1331d68a0f77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:43:34.213543 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18ca837-9c26-425f-990c-1331d68a0f77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:43:34.215006 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18ca837-9c26-425f-990c-1331d68a0f77 service cinder] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:43:34.224253 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 571/1159] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Aug 18 19:43:34 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:43:36.404690 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3039a6c8-4983-499e-8e17-331af400d547 None None] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:43:36.405243 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3039a6c8-4983-499e-8e17-331af400d547 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:43:36.405243 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3039a6c8-4983-499e-8e17-331af400d547 None None] PATH_INFO: `/` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:43:36.406710 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 589/1160] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 19:43:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:43:36.412167 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a728f-81cf-43ec-97c1-bb2e049eb28e None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:43:36.412580 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a728f-81cf-43ec-97c1-bb2e049eb28e None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:43:36.412720 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a728f-81cf-43ec-97c1-bb2e049eb28e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:43:36.432781 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-914a728f-81cf-43ec-97c1-bb2e049eb28e None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:43:36.434014 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-914a728f-81cf-43ec-97c1-bb2e049eb28e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:43:36.441740 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 572/1161] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 19:43:36 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:43:37.013065 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3039a6c8-4983-499e-8e17-331af400d547 None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:43:37.014776 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-3039a6c8-4983-499e-8e17-331af400d547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:43:37.027502 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3039a6c8-4983-499e-8e17-331af400d547 None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:43:37.030917 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99558b1-9da4-405d-bcf7-212c7d60f56c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28c99ca9206340269f30be592fcd3f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a44b197c3aa0479092f4d77d2c791c39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:43:37.031498 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99558b1-9da4-405d-bcf7-212c7d60f56c service cinder] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:43:37.031775 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99558b1-9da4-405d-bcf7-212c7d60f56c service cinder] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:43:37.032046 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99558b1-9da4-405d-bcf7-212c7d60f56c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:43:37.041273 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99558b1-9da4-405d-bcf7-212c7d60f56c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:43:37.042717 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99558b1-9da4-405d-bcf7-212c7d60f56c service cinder] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:43:37.052715 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 590/1162] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Aug 18 19:43:37 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:43:46.428104 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=57 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:43:47.048063 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=42 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:44:51.951119 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457cba5a-2d36-4d29-9a41-b370cf2b53f6 None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:44:51.951818 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457cba5a-2d36-4d29-9a41-b370cf2b53f6 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:44:51.951818 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457cba5a-2d36-4d29-9a41-b370cf2b53f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:44:51.956034 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e3c8e5-41cb-47a0-a48b-cc5f38a5246f None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:44:51.956485 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e3c8e5-41cb-47a0-a48b-cc5f38a5246f None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:44:51.956587 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e3c8e5-41cb-47a0-a48b-cc5f38a5246f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:44:51.971384 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-457cba5a-2d36-4d29-9a41-b370cf2b53f6 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:44:51.972597 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-457cba5a-2d36-4d29-9a41-b370cf2b53f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:44:51.975274 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-e3e3c8e5-41cb-47a0-a48b-cc5f38a5246f None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:44:51.976446 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-e3e3c8e5-41cb-47a0-a48b-cc5f38a5246f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:44:51.980391 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 573/1163] 10.222.0.23 () {58 vars in 958 bytes} [Thu Aug 18 19:44:51 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:44:51.984142 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 591/1164] 10.222.0.23 () {58 vars in 958 bytes} [Thu Aug 18 19:44:51 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 19:44:51.988674 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bebbe4-3f62-447b-b19b-209691829445 None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:44:51.988993 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bebbe4-3f62-447b-b19b-209691829445 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:44:51.989267 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bebbe4-3f62-447b-b19b-209691829445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:44:51.991922 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1800162-ee03-4c93-a19d-2678b4be79aa None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:44:51.992262 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1800162-ee03-4c93-a19d-2678b4be79aa None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:44:51.992546 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1800162-ee03-4c93-a19d-2678b4be79aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:44:52.008710 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-45bebbe4-3f62-447b-b19b-209691829445 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:44:52.009932 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-45bebbe4-3f62-447b-b19b-209691829445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:44:52.011745 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-d1800162-ee03-4c93-a19d-2678b4be79aa None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:44:52.012900 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-d1800162-ee03-4c93-a19d-2678b4be79aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:44:52.019077 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 574/1165] 10.222.0.23 () {58 vars in 958 bytes} [Thu Aug 18 19:44:51 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:44:52.021277 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 592/1166] 10.222.0.23 () {58 vars in 958 bytes} [Thu Aug 18 19:44:51 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 19:44:52.023461 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bebbe4-3f62-447b-b19b-209691829445 None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:44:52.025469 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1800162-ee03-4c93-a19d-2678b4be79aa None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:44:52.032407 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bebbe4-3f62-447b-b19b-209691829445 None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:44:52.034514 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1800162-ee03-4c93-a19d-2678b4be79aa None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:44:52.036999 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d243459-0818-4185-86b8-dde462e0f0e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df56ebe1a05047a7a4d05174a8a4c7f1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:44:52.037581 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d243459-0818-4185-86b8-dde462e0f0e7 admin admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:44:52.037889 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d243459-0818-4185-86b8-dde462e0f0e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:44:52.038156 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d243459-0818-4185-86b8-dde462e0f0e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:44:52.038773 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d243459-0818-4185-86b8-dde462e0f0e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:44:52.039071 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d243459-0818-4185-86b8-dde462e0f0e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:44:52.039188 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cb61d6-145f-4544-bead-6218fb70219f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df56ebe1a05047a7a4d05174a8a4c7f1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:44:52.039725 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb61d6-145f-4544-bead-6218fb70219f admin admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:44:52.040002 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb61d6-145f-4544-bead-6218fb70219f admin admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:44:52.040272 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb61d6-145f-4544-bead-6218fb70219f admin admin] PATH_INFO: `/v3/domains` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:44:52.040638 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d243459-0818-4185-86b8-dde462e0f0e7 admin admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:44:52.040899 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cb61d6-145f-4544-bead-6218fb70219f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88470) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 19:44:52.041198 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cb61d6-145f-4544-bead-6218fb70219f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:44:52.042504 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: WARNING py.warnings [None req-a7cb61d6-145f-4544-bead-6218fb70219f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 19:44:52.042504 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: warnings.warn(msg) Aug 18 19:44:52.042504 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: Aug 18 19:44:52.043377 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cb61d6-145f-4544-bead-6218fb70219f admin admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:44:52.052285 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 575/1167] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Aug 18 19:44:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:44:52.057768 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 593/1168] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Aug 18 19:44:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 19:44:52.063863 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d243459-0818-4185-86b8-dde462e0f0e7 admin admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:44:52.064003 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cb61d6-145f-4544-bead-6218fb70219f admin admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:44:52.073090 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cb61d6-145f-4544-bead-6218fb70219f admin admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:44:52.073946 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d243459-0818-4185-86b8-dde462e0f0e7 admin admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:44:52.077769 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3c83df-5a57-4533-b4d5-45f84a693b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df56ebe1a05047a7a4d05174a8a4c7f1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:44:52.078928 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3c83df-5a57-4533-b4d5-45f84a693b7f admin admin] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:44:52.079183 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383ca24f-e7eb-48e3-876e-9694d140b5af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df56ebe1a05047a7a4d05174a8a4c7f1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:44:52.079308 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3c83df-5a57-4533-b4d5-45f84a693b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:44:52.079457 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3c83df-5a57-4533-b4d5-45f84a693b7f admin admin] PATH_INFO: `/v3/projects` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:44:52.079776 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383ca24f-e7eb-48e3-876e-9694d140b5af admin admin] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:44:52.080053 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383ca24f-e7eb-48e3-876e-9694d140b5af admin admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:44:52.080148 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3c83df-5a57-4533-b4d5-45f84a693b7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:44:52.080326 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383ca24f-e7eb-48e3-876e-9694d140b5af admin admin] PATH_INFO: `/v3/projects` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:44:52.080951 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383ca24f-e7eb-48e3-876e-9694d140b5af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:44:52.081980 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: WARNING py.warnings [None req-383ca24f-e7eb-48e3-876e-9694d140b5af admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 19:44:52.081980 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: warnings.warn(msg) Aug 18 19:44:52.081980 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: Aug 18 19:44:52.082224 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3c83df-5a57-4533-b4d5-45f84a693b7f admin admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:44:52.083187 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383ca24f-e7eb-48e3-876e-9694d140b5af admin admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:44:52.178211 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 594/1169] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Aug 18 19:44:52 2022] POST /identity/v3/projects => generated 385 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 19:44:52.182421 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3c83df-5a57-4533-b4d5-45f84a693b7f admin admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:44:52.190468 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 576/1170] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Aug 18 19:44:52 2022] POST /identity/v3/projects => generated 377 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 19:44:52.194492 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383ca24f-e7eb-48e3-876e-9694d140b5af admin admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:44:52.243638 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3c83df-5a57-4533-b4d5-45f84a693b7f admin admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:44:52.257371 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383ca24f-e7eb-48e3-876e-9694d140b5af admin admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:44:52.262129 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec1f013-8e76-4074-99b9-144247c7d24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df56ebe1a05047a7a4d05174a8a4c7f1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:44:52.262965 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec1f013-8e76-4074-99b9-144247c7d24e admin admin] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:44:52.263096 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec1f013-8e76-4074-99b9-144247c7d24e admin admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:44:52.263306 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec1f013-8e76-4074-99b9-144247c7d24e admin admin] PATH_INFO: `/v3/users` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:44:52.263928 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec1f013-8e76-4074-99b9-144247c7d24e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:44:52.266540 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec1f013-8e76-4074-99b9-144247c7d24e admin admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:44:52.298720 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72680c3-6461-4503-9df4-2426fad6e85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df56ebe1a05047a7a4d05174a8a4c7f1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:44:52.299324 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72680c3-6461-4503-9df4-2426fad6e85e admin admin] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:44:52.299603 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72680c3-6461-4503-9df4-2426fad6e85e admin admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:44:52.299879 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72680c3-6461-4503-9df4-2426fad6e85e admin admin] PATH_INFO: `/v3/users` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:44:52.300485 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72680c3-6461-4503-9df4-2426fad6e85e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:44:52.301496 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: WARNING py.warnings [None req-a72680c3-6461-4503-9df4-2426fad6e85e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 19:44:52.301496 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: warnings.warn(msg) Aug 18 19:44:52.301496 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: Aug 18 19:44:52.302735 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72680c3-6461-4503-9df4-2426fad6e85e admin admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:44:52.371426 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 577/1171] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Aug 18 19:44:52 2022] POST /identity/v3/users => generated 289 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 19:44:52.376152 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec1f013-8e76-4074-99b9-144247c7d24e admin admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:44:52.386324 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec1f013-8e76-4074-99b9-144247c7d24e admin admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:44:52.390868 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7a8424-7286-4c7d-a705-902e340067e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df56ebe1a05047a7a4d05174a8a4c7f1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:44:52.391454 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7a8424-7286-4c7d-a705-902e340067e0 admin admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:44:52.391734 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7a8424-7286-4c7d-a705-902e340067e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:44:52.392003 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7a8424-7286-4c7d-a705-902e340067e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:44:52.392776 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7a8424-7286-4c7d-a705-902e340067e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:44:52.394241 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7a8424-7286-4c7d-a705-902e340067e0 admin admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:44:52.401288 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 595/1172] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Aug 18 19:44:52 2022] POST /identity/v3/users => generated 293 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 19:44:52.404546 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 578/1173] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Aug 18 19:44:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 19:44:52.407374 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72680c3-6461-4503-9df4-2426fad6e85e admin admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:44:52.408359 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7a8424-7286-4c7d-a705-902e340067e0 admin admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:44:52.417472 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72680c3-6461-4503-9df4-2426fad6e85e admin admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:44:52.418052 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7a8424-7286-4c7d-a705-902e340067e0 admin admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:44:52.422666 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa534e9-fe09-46f1-b2cf-451a9e03fb0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df56ebe1a05047a7a4d05174a8a4c7f1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:44:52.423214 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84745972-a320-4ac9-beaa-100916952abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df56ebe1a05047a7a4d05174a8a4c7f1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:44:52.423338 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa534e9-fe09-46f1-b2cf-451a9e03fb0b admin admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:44:52.423517 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa534e9-fe09-46f1-b2cf-451a9e03fb0b admin admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:44:52.423786 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84745972-a320-4ac9-beaa-100916952abe admin admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:44:52.423892 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa534e9-fe09-46f1-b2cf-451a9e03fb0b admin admin] PATH_INFO: `/v3/roles` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:44:52.424066 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84745972-a320-4ac9-beaa-100916952abe admin admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:44:52.424338 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84745972-a320-4ac9-beaa-100916952abe admin admin] PATH_INFO: `/v3/roles` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:44:52.424450 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa534e9-fe09-46f1-b2cf-451a9e03fb0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:44:52.424956 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84745972-a320-4ac9-beaa-100916952abe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:44:52.426051 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa534e9-fe09-46f1-b2cf-451a9e03fb0b admin admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:44:52.426646 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84745972-a320-4ac9-beaa-100916952abe admin admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:44:52.439951 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 596/1174] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Aug 18 19:44:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 19:44:52.440148 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 579/1175] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Aug 18 19:44:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 19:44:52.441813 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84745972-a320-4ac9-beaa-100916952abe admin admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:44:52.441951 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa534e9-fe09-46f1-b2cf-451a9e03fb0b admin admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:44:52.451385 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84745972-a320-4ac9-beaa-100916952abe admin admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:44:52.452009 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa534e9-fe09-46f1-b2cf-451a9e03fb0b admin admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:44:52.455958 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3d488f-7089-4892-bb76-948aa7a80023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df56ebe1a05047a7a4d05174a8a4c7f1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:44:52.456496 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed418e5d-81fa-401f-b241-2369639a5f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df56ebe1a05047a7a4d05174a8a4c7f1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:44:52.456638 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d488f-7089-4892-bb76-948aa7a80023 admin admin] REQUEST_METHOD: `PUT` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:44:52.456840 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d488f-7089-4892-bb76-948aa7a80023 admin admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:44:52.457073 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed418e5d-81fa-401f-b241-2369639a5f5d admin admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:44:52.457185 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d488f-7089-4892-bb76-948aa7a80023 admin admin] PATH_INFO: `/v3/projects/33ba909822bf464794b58d89598a9ffb/users/30f69f380a2c49258fb1a332bf1e012d/roles/ece5eb2bd1334192b3eee1b7b05c042c` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:44:52.457352 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed418e5d-81fa-401f-b241-2369639a5f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:44:52.457624 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed418e5d-81fa-401f-b241-2369639a5f5d admin admin] PATH_INFO: `/v3/roles` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:44:52.458297 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed418e5d-81fa-401f-b241-2369639a5f5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:44:52.460645 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed418e5d-81fa-401f-b241-2369639a5f5d admin admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:44:52.470229 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 597/1176] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Aug 18 19:44:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 19:44:52.471285 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3d488f-7089-4892-bb76-948aa7a80023 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33ba909822bf464794b58d89598a9ffb, user_id=30f69f380a2c49258fb1a332bf1e012d, role_id=ece5eb2bd1334192b3eee1b7b05c042c)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:44:52.472299 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: WARNING py.warnings [None req-7b3d488f-7089-4892-bb76-948aa7a80023 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 19:44:52.472299 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: warnings.warn(msg) Aug 18 19:44:52.472299 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: Aug 18 19:44:52.474257 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3d488f-7089-4892-bb76-948aa7a80023 admin admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:44:52.474535 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed418e5d-81fa-401f-b241-2369639a5f5d admin admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:44:52.483805 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed418e5d-81fa-401f-b241-2369639a5f5d admin admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:44:52.492222 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ff50b9-299d-48b1-9ddb-aa1efa58d9bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df56ebe1a05047a7a4d05174a8a4c7f1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:44:52.492222 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff50b9-299d-48b1-9ddb-aa1efa58d9bc admin admin] REQUEST_METHOD: `PUT` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:44:52.492222 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff50b9-299d-48b1-9ddb-aa1efa58d9bc admin admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:44:52.492222 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff50b9-299d-48b1-9ddb-aa1efa58d9bc admin admin] PATH_INFO: `/v3/projects/20868e2c86564c6eb7fca9b1d6cb32e7/users/fffe0e01e05f475784d774e8e3670ce5/roles/ece5eb2bd1334192b3eee1b7b05c042c` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:44:52.504599 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ff50b9-299d-48b1-9ddb-aa1efa58d9bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=20868e2c86564c6eb7fca9b1d6cb32e7, user_id=fffe0e01e05f475784d774e8e3670ce5, role_id=ece5eb2bd1334192b3eee1b7b05c042c)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:44:52.507210 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ff50b9-299d-48b1-9ddb-aa1efa58d9bc admin admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:44:52.571873 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 580/1177] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Aug 18 19:44:52 2022] PUT /identity/v3/projects/33ba909822bf464794b58d89598a9ffb/users/30f69f380a2c49258fb1a332bf1e012d/roles/ece5eb2bd1334192b3eee1b7b05c042c => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 19:44:52.576814 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2d1e0e-f28d-4e7b-b580-a9f27aa42d5f None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:44:52.577107 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2d1e0e-f28d-4e7b-b580-a9f27aa42d5f None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:44:52.577386 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2d1e0e-f28d-4e7b-b580-a9f27aa42d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:44:52.595294 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-0d2d1e0e-f28d-4e7b-b580-a9f27aa42d5f None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:44:52.598817 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-0d2d1e0e-f28d-4e7b-b580-a9f27aa42d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:44:52.600518 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 598/1178] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Aug 18 19:44:52 2022] PUT /identity/v3/projects/20868e2c86564c6eb7fca9b1d6cb32e7/users/fffe0e01e05f475784d774e8e3670ce5/roles/ece5eb2bd1334192b3eee1b7b05c042c => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 19:44:52.605856 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e9c7b2-121f-42c9-8b65-b4f8d5704951 None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:44:52.606599 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e9c7b2-121f-42c9-8b65-b4f8d5704951 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:44:52.606931 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e9c7b2-121f-42c9-8b65-b4f8d5704951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:44:52.615756 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:44:52.628955 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-58e9c7b2-121f-42c9-8b65-b4f8d5704951 None None] MFA Rules not processed for user `f765ddb0f75b40179001f4a64546ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:44:52.630216 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-58e9c7b2-121f-42c9-8b65-b4f8d5704951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:44:52.645933 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:44:52.657188 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 581/1179] 10.222.0.23 () {58 vars in 958 bytes} [Thu Aug 18 19:44:52 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 19:44:52.668288 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2d1e0e-f28d-4e7b-b580-a9f27aa42d5f None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:44:52.673468 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-0d2d1e0e-f28d-4e7b-b580-a9f27aa42d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:44:52.693363 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 599/1180] 10.222.0.23 () {58 vars in 958 bytes} [Thu Aug 18 19:44:52 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:44:52.702883 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e9c7b2-121f-42c9-8b65-b4f8d5704951 None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:44:52.704318 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-58e9c7b2-121f-42c9-8b65-b4f8d5704951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:44:52.727702 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2d1e0e-f28d-4e7b-b580-a9f27aa42d5f None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:44:52.731340 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c316730-9896-4c22-a9e4-74ccba7f02fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '516923ce386f459190af3fd7eaa81551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a44b197c3aa0479092f4d77d2c791c39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:44:52.731945 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c316730-9896-4c22-a9e4-74ccba7f02fc service neutron] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:44:52.732222 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c316730-9896-4c22-a9e4-74ccba7f02fc service neutron] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:44:52.732497 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c316730-9896-4c22-a9e4-74ccba7f02fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:44:52.742202 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c316730-9896-4c22-a9e4-74ccba7f02fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:44:52.743914 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c316730-9896-4c22-a9e4-74ccba7f02fc service neutron] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:44:52.753620 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 582/1181] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Aug 18 19:44:52 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 19:44:52.761526 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e9c7b2-121f-42c9-8b65-b4f8d5704951 None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:44:52.765334 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5776778-56cc-4264-bce5-113e4e1ce5f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '516923ce386f459190af3fd7eaa81551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a44b197c3aa0479092f4d77d2c791c39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:44:52.766106 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5776778-56cc-4264-bce5-113e4e1ce5f4 service neutron] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:44:52.766458 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5776778-56cc-4264-bce5-113e4e1ce5f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:44:52.766739 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5776778-56cc-4264-bce5-113e4e1ce5f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:44:52.776403 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5776778-56cc-4264-bce5-113e4e1ce5f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:44:52.781759 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5776778-56cc-4264-bce5-113e4e1ce5f4 service neutron] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:44:52.787988 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 600/1182] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Aug 18 19:44:52 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 19:44:58.974933 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b7e32-6c47-4506-8267-5957047309d4 None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:44:58.975890 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b7e32-6c47-4506-8267-5957047309d4 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:44:58.976338 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b7e32-6c47-4506-8267-5957047309d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:44:59.012174 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-5d7b7e32-6c47-4506-8267-5957047309d4 None None] MFA Rules not processed for user `fffe0e01e05f475784d774e8e3670ce5`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:44:59.014501 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-5d7b7e32-6c47-4506-8267-5957047309d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:44:59.124402 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 583/1183] 10.222.0.23 () {58 vars in 958 bytes} [Thu Aug 18 19:44:58 2022] POST /identity/v3/auth/tokens => generated 2822 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:44:59.134343 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5776778-56cc-4264-bce5-113e4e1ce5f4 service neutron] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:44:59.144492 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5776778-56cc-4264-bce5-113e4e1ce5f4 service neutron] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:44:59.149640 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889a7d50-ba36-4eb8-b20a-c46d6cb8465f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df56ebe1a05047a7a4d05174a8a4c7f1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:44:59.150393 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a7d50-ba36-4eb8-b20a-c46d6cb8465f admin admin] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:44:59.150673 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a7d50-ba36-4eb8-b20a-c46d6cb8465f admin admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:44:59.150945 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a7d50-ba36-4eb8-b20a-c46d6cb8465f admin admin] PATH_INFO: `/v3/projects` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:44:59.151772 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889a7d50-ba36-4eb8-b20a-c46d6cb8465f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:44:59.154211 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889a7d50-ba36-4eb8-b20a-c46d6cb8465f admin admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:44:59.244687 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 601/1184] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Aug 18 19:44:59 2022] POST /identity/v3/projects => generated 385 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 19:44:59.248752 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b7e32-6c47-4506-8267-5957047309d4 None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:44:59.261349 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b7e32-6c47-4506-8267-5957047309d4 None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:44:59.385983 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8e0dbf-4f10-4470-b9a0-9eb993fa84c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df56ebe1a05047a7a4d05174a8a4c7f1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:44:59.394438 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8e0dbf-4f10-4470-b9a0-9eb993fa84c8 admin admin] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:44:59.399423 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8e0dbf-4f10-4470-b9a0-9eb993fa84c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:44:59.399423 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8e0dbf-4f10-4470-b9a0-9eb993fa84c8 admin admin] PATH_INFO: `/v3/users` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:44:59.399423 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8e0dbf-4f10-4470-b9a0-9eb993fa84c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:44:59.410285 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8e0dbf-4f10-4470-b9a0-9eb993fa84c8 admin admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:44:59.546702 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 584/1185] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Aug 18 19:44:59 2022] POST /identity/v3/users => generated 299 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 19:44:59.550995 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889a7d50-ba36-4eb8-b20a-c46d6cb8465f admin admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:44:59.568480 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889a7d50-ba36-4eb8-b20a-c46d6cb8465f admin admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:44:59.574305 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433f70be-9526-4def-b682-a0dfd28a64fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df56ebe1a05047a7a4d05174a8a4c7f1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:44:59.574950 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433f70be-9526-4def-b682-a0dfd28a64fc admin admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:44:59.584002 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433f70be-9526-4def-b682-a0dfd28a64fc admin admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:44:59.584002 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433f70be-9526-4def-b682-a0dfd28a64fc admin admin] PATH_INFO: `/v3/roles` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:44:59.584002 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433f70be-9526-4def-b682-a0dfd28a64fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:44:59.584002 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433f70be-9526-4def-b682-a0dfd28a64fc admin admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:44:59.598513 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 602/1186] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Aug 18 19:44:59 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 19:44:59.602801 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8e0dbf-4f10-4470-b9a0-9eb993fa84c8 admin admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:44:59.617125 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8e0dbf-4f10-4470-b9a0-9eb993fa84c8 admin admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:44:59.631174 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ee08c5-cec8-4a87-b9e6-f649a995c6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df56ebe1a05047a7a4d05174a8a4c7f1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:44:59.632221 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ee08c5-cec8-4a87-b9e6-f649a995c6d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:44:59.632347 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ee08c5-cec8-4a87-b9e6-f649a995c6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:44:59.632566 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ee08c5-cec8-4a87-b9e6-f649a995c6d7 admin admin] PATH_INFO: `/v3/projects/4dcd61cf33fe45119cfc78a22b42a794/users/a44ce3e03c6b4e61a7093ce498bdfa32/roles/33fe6be3baf44b969c8166af5142e0c7` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:44:59.669823 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ee08c5-cec8-4a87-b9e6-f649a995c6d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dcd61cf33fe45119cfc78a22b42a794, user_id=a44ce3e03c6b4e61a7093ce498bdfa32, role_id=33fe6be3baf44b969c8166af5142e0c7)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:44:59.678104 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ee08c5-cec8-4a87-b9e6-f649a995c6d7 admin admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:44:59.681290 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:44:59.691512 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873db0e2-62f7-45cc-9038-739ca89e1c3a None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:44:59.692345 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873db0e2-62f7-45cc-9038-739ca89e1c3a None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:44:59.692627 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873db0e2-62f7-45cc-9038-739ca89e1c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:44:59.744474 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-873db0e2-62f7-45cc-9038-739ca89e1c3a None None] MFA Rules not processed for user `30f69f380a2c49258fb1a332bf1e012d`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:44:59.746447 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-873db0e2-62f7-45cc-9038-739ca89e1c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:44:59.790591 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 585/1187] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Aug 18 19:44:59 2022] PUT /identity/v3/projects/4dcd61cf33fe45119cfc78a22b42a794/users/a44ce3e03c6b4e61a7093ce498bdfa32/roles/33fe6be3baf44b969c8166af5142e0c7 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 19:44:59.794981 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ee08c5-cec8-4a87-b9e6-f649a995c6d7 admin admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:44:59.901936 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ee08c5-cec8-4a87-b9e6-f649a995c6d7 admin admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:44:59.903156 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 603/1188] 10.222.0.23 () {58 vars in 958 bytes} [Thu Aug 18 19:44:59 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:44:59.907436 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873db0e2-62f7-45cc-9038-739ca89e1c3a None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:44:59.913259 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfc6f48-199d-4511-972e-67f47d209a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df56ebe1a05047a7a4d05174a8a4c7f1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:44:59.913259 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfc6f48-199d-4511-972e-67f47d209a4b admin admin] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:44:59.913682 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfc6f48-199d-4511-972e-67f47d209a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:44:59.913968 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:44:59.914240 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfc6f48-199d-4511-972e-67f47d209a4b admin admin] PATH_INFO: `/v3/roles` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:44:59.916177 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfc6f48-199d-4511-972e-67f47d209a4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:44:59.919034 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfc6f48-199d-4511-972e-67f47d209a4b admin admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:44:59.920940 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873db0e2-62f7-45cc-9038-739ca89e1c3a None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:44:59.925963 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b44f472-1867-4711-83cf-644c4bb78994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df56ebe1a05047a7a4d05174a8a4c7f1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:44:59.926586 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b44f472-1867-4711-83cf-644c4bb78994 admin admin] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:44:59.926881 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b44f472-1867-4711-83cf-644c4bb78994 admin admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:44:59.927137 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b44f472-1867-4711-83cf-644c4bb78994 admin admin] PATH_INFO: `/v3/projects` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:44:59.931965 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b44f472-1867-4711-83cf-644c4bb78994 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:44:59.931965 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b44f472-1867-4711-83cf-644c4bb78994 admin admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:44:59.952319 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 586/1189] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Aug 18 19:44:59 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 19:44:59.953584 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfc6f48-199d-4511-972e-67f47d209a4b admin admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:44:59.965086 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfc6f48-199d-4511-972e-67f47d209a4b admin admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:44:59.970095 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db27f359-2e10-403b-be5d-d1b9ad1d469f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df56ebe1a05047a7a4d05174a8a4c7f1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:44:59.971475 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db27f359-2e10-403b-be5d-d1b9ad1d469f admin admin] REQUEST_METHOD: `PUT` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:44:59.971757 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db27f359-2e10-403b-be5d-d1b9ad1d469f admin admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:44:59.972042 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db27f359-2e10-403b-be5d-d1b9ad1d469f admin admin] PATH_INFO: `/v3/projects/4dcd61cf33fe45119cfc78a22b42a794/users/a44ce3e03c6b4e61a7093ce498bdfa32/roles/33fe6be3baf44b969c8166af5142e0c7` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:44:59.974169 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db27f359-2e10-403b-be5d-d1b9ad1d469f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dcd61cf33fe45119cfc78a22b42a794, user_id=a44ce3e03c6b4e61a7093ce498bdfa32, role_id=33fe6be3baf44b969c8166af5142e0c7)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:44:59.976843 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db27f359-2e10-403b-be5d-d1b9ad1d469f admin admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:44:59.988413 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 587/1190] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Aug 18 19:44:59 2022] PUT /identity/v3/projects/4dcd61cf33fe45119cfc78a22b42a794/users/a44ce3e03c6b4e61a7093ce498bdfa32/roles/33fe6be3baf44b969c8166af5142e0c7 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 19:45:00.041694 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 604/1191] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Aug 18 19:44:59 2022] POST /identity/v3/projects => generated 379 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 19:45:00.045799 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db27f359-2e10-403b-be5d-d1b9ad1d469f admin admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:45:00.129025 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db27f359-2e10-403b-be5d-d1b9ad1d469f admin admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:45:00.240530 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4958a535-b952-45b0-a06a-573ed747f0c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df56ebe1a05047a7a4d05174a8a4c7f1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:45:00.241592 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4958a535-b952-45b0-a06a-573ed747f0c7 admin admin] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:45:00.242188 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4958a535-b952-45b0-a06a-573ed747f0c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:45:00.242909 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4958a535-b952-45b0-a06a-573ed747f0c7 admin admin] PATH_INFO: `/v3/users` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:45:00.243781 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4958a535-b952-45b0-a06a-573ed747f0c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:45:00.247130 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4958a535-b952-45b0-a06a-573ed747f0c7 admin admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:45:00.383690 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 588/1192] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Aug 18 19:45:00 2022] POST /identity/v3/users => generated 296 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 19:45:00.389231 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b44f472-1867-4711-83cf-644c4bb78994 admin admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:45:00.408538 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b44f472-1867-4711-83cf-644c4bb78994 admin admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:45:00.420930 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d75320-9c6f-46f4-96a3-9cec29145f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df56ebe1a05047a7a4d05174a8a4c7f1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:45:00.421564 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d75320-9c6f-46f4-96a3-9cec29145f38 admin admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:45:00.423677 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d75320-9c6f-46f4-96a3-9cec29145f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:45:00.423677 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d75320-9c6f-46f4-96a3-9cec29145f38 admin admin] PATH_INFO: `/v3/roles` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:45:00.423677 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d75320-9c6f-46f4-96a3-9cec29145f38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:45:00.424437 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d75320-9c6f-46f4-96a3-9cec29145f38 admin admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:45:00.454275 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 605/1193] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Aug 18 19:45:00 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 19:45:00.456127 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4958a535-b952-45b0-a06a-573ed747f0c7 admin admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:45:00.476386 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4958a535-b952-45b0-a06a-573ed747f0c7 admin admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:45:00.490634 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14135d0b-48f1-462f-bca5-d0ac629d3d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df56ebe1a05047a7a4d05174a8a4c7f1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:45:00.491329 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14135d0b-48f1-462f-bca5-d0ac629d3d45 admin admin] REQUEST_METHOD: `PUT` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:45:00.491609 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14135d0b-48f1-462f-bca5-d0ac629d3d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:45:00.491882 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14135d0b-48f1-462f-bca5-d0ac629d3d45 admin admin] PATH_INFO: `/v3/projects/95649e24365742d6aa91be9275aca754/users/49262c48a1c74ae6b5bfc239ab5b42b9/roles/33fe6be3baf44b969c8166af5142e0c7` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:45:00.505856 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:45:00.511817 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14135d0b-48f1-462f-bca5-d0ac629d3d45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95649e24365742d6aa91be9275aca754, user_id=49262c48a1c74ae6b5bfc239ab5b42b9, role_id=33fe6be3baf44b969c8166af5142e0c7)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:45:00.514843 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14135d0b-48f1-462f-bca5-d0ac629d3d45 admin admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:45:00.618714 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 589/1194] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Aug 18 19:45:00 2022] PUT /identity/v3/projects/95649e24365742d6aa91be9275aca754/users/49262c48a1c74ae6b5bfc239ab5b42b9/roles/33fe6be3baf44b969c8166af5142e0c7 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 19:45:00.622974 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d75320-9c6f-46f4-96a3-9cec29145f38 admin admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:45:00.635288 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d75320-9c6f-46f4-96a3-9cec29145f38 admin admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:45:00.720495 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80287ea7-a07b-4060-9f6d-cbbd95c5ed97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df56ebe1a05047a7a4d05174a8a4c7f1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:45:00.721169 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80287ea7-a07b-4060-9f6d-cbbd95c5ed97 admin admin] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:45:00.721471 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80287ea7-a07b-4060-9f6d-cbbd95c5ed97 admin admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:45:00.721790 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80287ea7-a07b-4060-9f6d-cbbd95c5ed97 admin admin] PATH_INFO: `/v3/roles` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:45:00.722497 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80287ea7-a07b-4060-9f6d-cbbd95c5ed97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:45:00.724188 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80287ea7-a07b-4060-9f6d-cbbd95c5ed97 admin admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:45:00.740673 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 606/1195] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Aug 18 19:45:00 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 19:45:00.747074 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14135d0b-48f1-462f-bca5-d0ac629d3d45 admin admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:45:00.754517 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14135d0b-48f1-462f-bca5-d0ac629d3d45 admin admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:45:00.759592 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67efd48-3efb-449d-bd29-9285f9e5aa2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df56ebe1a05047a7a4d05174a8a4c7f1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:45:00.760335 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67efd48-3efb-449d-bd29-9285f9e5aa2a admin admin] REQUEST_METHOD: `PUT` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:45:00.760619 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67efd48-3efb-449d-bd29-9285f9e5aa2a admin admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:45:00.760892 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67efd48-3efb-449d-bd29-9285f9e5aa2a admin admin] PATH_INFO: `/v3/projects/95649e24365742d6aa91be9275aca754/users/49262c48a1c74ae6b5bfc239ab5b42b9/roles/33fe6be3baf44b969c8166af5142e0c7` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:45:00.762848 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67efd48-3efb-449d-bd29-9285f9e5aa2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=95649e24365742d6aa91be9275aca754, user_id=49262c48a1c74ae6b5bfc239ab5b42b9, role_id=33fe6be3baf44b969c8166af5142e0c7)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:45:00.765775 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67efd48-3efb-449d-bd29-9285f9e5aa2a admin admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:45:00.781388 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 590/1196] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Aug 18 19:45:00 2022] PUT /identity/v3/projects/95649e24365742d6aa91be9275aca754/users/49262c48a1c74ae6b5bfc239ab5b42b9/roles/33fe6be3baf44b969c8166af5142e0c7 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 19:45:07.827321 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60642d0b-18b1-499e-ba60-3568d5cd6aa4 None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:45:07.827861 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60642d0b-18b1-499e-ba60-3568d5cd6aa4 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:45:07.828117 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60642d0b-18b1-499e-ba60-3568d5cd6aa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:45:07.863896 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-60642d0b-18b1-499e-ba60-3568d5cd6aa4 None None] MFA Rules not processed for user `a44ce3e03c6b4e61a7093ce498bdfa32`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:45:07.865175 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-60642d0b-18b1-499e-ba60-3568d5cd6aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:45:07.978207 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 607/1197] 10.222.0.23 () {58 vars in 958 bytes} [Thu Aug 18 19:45:07 2022] POST /identity/v3/auth/tokens => generated 2889 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:45:07.996254 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67efd48-3efb-449d-bd29-9285f9e5aa2a admin admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:45:07.998243 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-c67efd48-3efb-449d-bd29-9285f9e5aa2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:45:08.073782 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67efd48-3efb-449d-bd29-9285f9e5aa2a admin admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:45:08.077849 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eda3d6-1a1a-4d8a-83e5-c83c0522263d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62ab2be725844b49bde7941867d672d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a44b197c3aa0479092f4d77d2c791c39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:45:08.078702 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eda3d6-1a1a-4d8a-83e5-c83c0522263d service glance] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:45:08.079141 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eda3d6-1a1a-4d8a-83e5-c83c0522263d service glance] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:45:08.079588 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eda3d6-1a1a-4d8a-83e5-c83c0522263d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:45:08.124540 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20177da8-66ec-446f-8cc2-aef3bf421136 None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:45:08.124830 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20177da8-66ec-446f-8cc2-aef3bf421136 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:45:08.125106 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20177da8-66ec-446f-8cc2-aef3bf421136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:45:08.151562 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eda3d6-1a1a-4d8a-83e5-c83c0522263d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:45:08.154938 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eda3d6-1a1a-4d8a-83e5-c83c0522263d service glance] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:45:08.161550 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-20177da8-66ec-446f-8cc2-aef3bf421136 None None] MFA Rules not processed for user `49262c48a1c74ae6b5bfc239ab5b42b9`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:45:08.163300 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-20177da8-66ec-446f-8cc2-aef3bf421136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:45:08.167467 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 591/1198] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Aug 18 19:45:07 2022] GET /identity/v3/auth/tokens => generated 2822 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:45:08.224708 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:45:08.251879 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 608/1199] 10.222.0.23 () {58 vars in 958 bytes} [Thu Aug 18 19:45:08 2022] POST /identity/v3/auth/tokens => generated 2883 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 19:45:08.265373 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eda3d6-1a1a-4d8a-83e5-c83c0522263d service glance] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:45:08.266801 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-48eda3d6-1a1a-4d8a-83e5-c83c0522263d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:45:08.278068 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eda3d6-1a1a-4d8a-83e5-c83c0522263d service glance] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:45:08.281674 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eb386a-9a9d-4714-819f-b0956b12fb8e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62ab2be725844b49bde7941867d672d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a44b197c3aa0479092f4d77d2c791c39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:45:08.282346 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eb386a-9a9d-4714-819f-b0956b12fb8e service glance] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:45:08.282628 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eb386a-9a9d-4714-819f-b0956b12fb8e service glance] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:45:08.282903 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eb386a-9a9d-4714-819f-b0956b12fb8e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:45:08.349352 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eb386a-9a9d-4714-819f-b0956b12fb8e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:45:08.350968 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eb386a-9a9d-4714-819f-b0956b12fb8e service glance] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:45:08.361575 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 592/1200] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Aug 18 19:45:08 2022] GET /identity/v3/auth/tokens => generated 2814 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:45:18.215995 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f8d775-3274-4095-8b9d-e608aaf126c0 None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:45:18.216580 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f8d775-3274-4095-8b9d-e608aaf126c0 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:45:18.216580 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f8d775-3274-4095-8b9d-e608aaf126c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:45:18.237511 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-c0f8d775-3274-4095-8b9d-e608aaf126c0 None None] MFA Rules not processed for user `fffe0e01e05f475784d774e8e3670ce5`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:45:18.238751 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-c0f8d775-3274-4095-8b9d-e608aaf126c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:45:18.248087 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 609/1201] 10.222.0.23 () {58 vars in 958 bytes} [Thu Aug 18 19:45:18 2022] POST /identity/v3/auth/tokens => generated 2822 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:45:18.357315 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=85,keystone:INSERT=2 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:45:18.540991 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f05bfab-61dd-4114-9ac3-bd8aa5893a2d None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:45:18.541285 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f05bfab-61dd-4114-9ac3-bd8aa5893a2d None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:45:18.541560 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f05bfab-61dd-4114-9ac3-bd8aa5893a2d None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:45:18.542936 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 593/1202] 10.222.0.23 () {54 vars in 962 bytes} [Thu Aug 18 19:45:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:45:18.548199 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e75cc0-2acb-43aa-9ed9-caa2d458f772 None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:45:18.548504 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e75cc0-2acb-43aa-9ed9-caa2d458f772 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:45:18.549044 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e75cc0-2acb-43aa-9ed9-caa2d458f772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:45:18.569112 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-33e75cc0-2acb-43aa-9ed9-caa2d458f772 None None] MFA Rules not processed for user `9c3560e900d248bc93147ddce515365b`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:45:18.571019 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-33e75cc0-2acb-43aa-9ed9-caa2d458f772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:45:18.642850 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 610/1203] 10.222.0.23 () {58 vars in 1059 bytes} [Thu Aug 18 19:45:18 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:45:18.648697 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b28833e-5457-444c-b7e5-1f63557c3cc6 None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:45:18.648984 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b28833e-5457-444c-b7e5-1f63557c3cc6 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:45:18.649471 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b28833e-5457-444c-b7e5-1f63557c3cc6 None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:45:18.650887 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 594/1204] 10.222.0.23 () {54 vars in 912 bytes} [Thu Aug 18 19:45:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 19:45:18.656943 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a48243d-fac1-48b4-aca5-620a14bdce57 None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:45:18.657357 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a48243d-fac1-48b4-aca5-620a14bdce57 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:45:18.657639 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a48243d-fac1-48b4-aca5-620a14bdce57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:45:18.681301 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-6a48243d-fac1-48b4-aca5-620a14bdce57 None None] MFA Rules not processed for user `9c3560e900d248bc93147ddce515365b`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:45:18.682667 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-6a48243d-fac1-48b4-aca5-620a14bdce57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:45:18.695164 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 611/1205] 10.222.0.23 () {58 vars in 1009 bytes} [Thu Aug 18 19:45:18 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:45:18.707238 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b28833e-5457-444c-b7e5-1f63557c3cc6 None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:45:18.719728 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b28833e-5457-444c-b7e5-1f63557c3cc6 None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:45:18.725472 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f1eac5-52d3-46b2-b3ce-f147abf5183c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62ab2be725844b49bde7941867d672d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a44b197c3aa0479092f4d77d2c791c39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:45:18.725472 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f1eac5-52d3-46b2-b3ce-f147abf5183c service glance] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:45:18.725472 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f1eac5-52d3-46b2-b3ce-f147abf5183c service glance] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:45:18.725472 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f1eac5-52d3-46b2-b3ce-f147abf5183c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:45:18.734601 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f1eac5-52d3-46b2-b3ce-f147abf5183c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:45:18.736082 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f1eac5-52d3-46b2-b3ce-f147abf5183c service glance] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:45:18.746559 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 595/1206] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Aug 18 19:45:18 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:45:19.149044 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61edeb2d-b6df-437b-969d-2aaaab335481 None None] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:45:19.149044 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61edeb2d-b6df-437b-969d-2aaaab335481 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:45:19.149044 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61edeb2d-b6df-437b-969d-2aaaab335481 None None] PATH_INFO: `/` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:45:19.149044 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 612/1207] 10.222.0.23 () {54 vars in 912 bytes} [Thu Aug 18 19:45:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:45:19.150476 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd7d8de-2c40-4c03-ad12-8ab9a19b2c95 None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:45:19.150476 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd7d8de-2c40-4c03-ad12-8ab9a19b2c95 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:45:19.150476 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd7d8de-2c40-4c03-ad12-8ab9a19b2c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:45:19.150476 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-0cd7d8de-2c40-4c03-ad12-8ab9a19b2c95 None None] MFA Rules not processed for user `516923ce386f459190af3fd7eaa81551`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:45:19.150476 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-0cd7d8de-2c40-4c03-ad12-8ab9a19b2c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:45:19.182844 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 596/1208] 10.222.0.23 () {58 vars in 1009 bytes} [Thu Aug 18 19:45:19 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:45:19.198330 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61edeb2d-b6df-437b-969d-2aaaab335481 None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:45:19.210981 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61edeb2d-b6df-437b-969d-2aaaab335481 None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:45:19.215062 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca99a411-a3b1-4aa2-8b98-4a654f502eb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '516923ce386f459190af3fd7eaa81551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a44b197c3aa0479092f4d77d2c791c39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:45:19.215703 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca99a411-a3b1-4aa2-8b98-4a654f502eb3 service neutron] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:45:19.216019 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca99a411-a3b1-4aa2-8b98-4a654f502eb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:45:19.216604 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca99a411-a3b1-4aa2-8b98-4a654f502eb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:45:19.224183 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca99a411-a3b1-4aa2-8b98-4a654f502eb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:45:19.225896 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca99a411-a3b1-4aa2-8b98-4a654f502eb3 service neutron] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:45:19.235514 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 613/1209] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Aug 18 19:45:19 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:45:19.717885 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07450dce-27d0-4fcf-adad-c78b5af1ebbd None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:45:19.718421 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07450dce-27d0-4fcf-adad-c78b5af1ebbd None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:45:19.718421 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07450dce-27d0-4fcf-adad-c78b5af1ebbd None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:45:19.719955 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 597/1210] 10.222.0.23 () {54 vars in 962 bytes} [Thu Aug 18 19:45:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:45:19.725479 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f11ab-17b7-43db-b24b-ee1a85ca92e0 None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:45:19.726031 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f11ab-17b7-43db-b24b-ee1a85ca92e0 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:45:19.726308 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f11ab-17b7-43db-b24b-ee1a85ca92e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:45:19.748189 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-7a9f11ab-17b7-43db-b24b-ee1a85ca92e0 None None] MFA Rules not processed for user `9c3560e900d248bc93147ddce515365b`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:45:19.749577 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-7a9f11ab-17b7-43db-b24b-ee1a85ca92e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:45:19.765559 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 614/1211] 10.222.0.23 () {58 vars in 1059 bytes} [Thu Aug 18 19:45:19 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:45:19.771866 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc310666-9688-468c-89f9-f14abd128c57 None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:45:19.772144 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc310666-9688-468c-89f9-f14abd128c57 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:45:19.772425 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc310666-9688-468c-89f9-f14abd128c57 None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:45:19.774477 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 598/1212] 10.222.0.23 () {54 vars in 912 bytes} [Thu Aug 18 19:45:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:45:19.777516 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a014f4-6545-49ed-8765-dc078ce47b37 None None] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:45:19.777850 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a014f4-6545-49ed-8765-dc078ce47b37 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:45:19.778387 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a014f4-6545-49ed-8765-dc078ce47b37 None None] PATH_INFO: `/` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:45:19.779470 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0f317-c5d3-4691-9cf4-33499ce734d2 None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:45:19.779802 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0f317-c5d3-4691-9cf4-33499ce734d2 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:45:19.779943 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 615/1213] 10.222.0.23 () {54 vars in 961 bytes} [Thu Aug 18 19:45:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:45:19.780078 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0f317-c5d3-4691-9cf4-33499ce734d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:45:19.784674 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3136a83-6c6d-4bc7-bd2d-76589b246cdd None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:45:19.784954 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3136a83-6c6d-4bc7-bd2d-76589b246cdd None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:45:19.785547 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3136a83-6c6d-4bc7-bd2d-76589b246cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:45:19.801672 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-8ef0f317-c5d3-4691-9cf4-33499ce734d2 None None] MFA Rules not processed for user `9c3560e900d248bc93147ddce515365b`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:45:19.802921 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-8ef0f317-c5d3-4691-9cf4-33499ce734d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:45:19.806526 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-f3136a83-6c6d-4bc7-bd2d-76589b246cdd None None] MFA Rules not processed for user `b80a74afafd94acd8703fda561e1e4cd`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:45:19.807734 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-f3136a83-6c6d-4bc7-bd2d-76589b246cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:45:19.813638 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 599/1214] 10.222.0.23 () {58 vars in 1009 bytes} [Thu Aug 18 19:45:19 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 19:45:19.831939 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef0f317-c5d3-4691-9cf4-33499ce734d2 None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:45:19.843314 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef0f317-c5d3-4691-9cf4-33499ce734d2 None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:45:19.847339 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a0acd6-3270-44a5-8d36-8bd362df88f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '516923ce386f459190af3fd7eaa81551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a44b197c3aa0479092f4d77d2c791c39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:45:19.848011 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a0acd6-3270-44a5-8d36-8bd362df88f9 service neutron] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:45:19.848294 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a0acd6-3270-44a5-8d36-8bd362df88f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:45:19.848565 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a0acd6-3270-44a5-8d36-8bd362df88f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:45:19.859072 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a0acd6-3270-44a5-8d36-8bd362df88f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:45:19.860492 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a0acd6-3270-44a5-8d36-8bd362df88f9 service neutron] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:45:19.871314 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 600/1215] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Aug 18 19:45:19 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 19:45:19.892229 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 616/1216] 10.222.0.23 () {58 vars in 1058 bytes} [Thu Aug 18 19:45:19 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 19:45:19.902796 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a0acd6-3270-44a5-8d36-8bd362df88f9 service neutron] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:45:19.918695 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a0acd6-3270-44a5-8d36-8bd362df88f9 service neutron] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:45:19.927060 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36336854-c30b-48bd-b166-cf43064cd729 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b80a74afafd94acd8703fda561e1e4cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a44b197c3aa0479092f4d77d2c791c39', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:45:19.927797 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36336854-c30b-48bd-b166-cf43064cd729 service placement] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:45:19.928309 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36336854-c30b-48bd-b166-cf43064cd729 service placement] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:45:19.928667 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36336854-c30b-48bd-b166-cf43064cd729 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:45:19.930690 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-36336854-c30b-48bd-b166-cf43064cd729 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:45:19.947093 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36336854-c30b-48bd-b166-cf43064cd729 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:45:19.948709 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36336854-c30b-48bd-b166-cf43064cd729 service placement] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:45:19.959512 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 601/1217] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Aug 18 19:45:19 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:45:29.875683 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=84 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:45:29.955424 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=44 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:45:35.043338 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba09bee6-7001-4953-8f89-92556bd68d64 None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:45:35.043975 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba09bee6-7001-4953-8f89-92556bd68d64 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:45:35.043975 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba09bee6-7001-4953-8f89-92556bd68d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:45:35.067758 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-ba09bee6-7001-4953-8f89-92556bd68d64 None None] MFA Rules not processed for user `516923ce386f459190af3fd7eaa81551`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:45:35.071051 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-ba09bee6-7001-4953-8f89-92556bd68d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:45:35.078214 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 617/1218] 10.222.0.50 () {58 vars in 1015 bytes} [Thu Aug 18 19:45:35 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:45:35.090616 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36336854-c30b-48bd-b166-cf43064cd729 service placement] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:45:35.102633 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36336854-c30b-48bd-b166-cf43064cd729 service placement] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:45:35.106296 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f1feb2-d5f3-450c-8b81-0698cd51f03e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '516923ce386f459190af3fd7eaa81551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a44b197c3aa0479092f4d77d2c791c39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:45:35.107016 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f1feb2-d5f3-450c-8b81-0698cd51f03e service neutron] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:45:35.107356 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f1feb2-d5f3-450c-8b81-0698cd51f03e service neutron] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:45:35.107565 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f1feb2-d5f3-450c-8b81-0698cd51f03e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:45:35.115215 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f1feb2-d5f3-450c-8b81-0698cd51f03e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:45:35.116682 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f1feb2-d5f3-450c-8b81-0698cd51f03e service neutron] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:45:35.124762 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 602/1219] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Aug 18 19:45:35 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:45:36.096397 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd42a3-ab6c-440f-8d03-dc71187e3229 None None] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:45:36.097327 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd42a3-ab6c-440f-8d03-dc71187e3229 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:45:36.097614 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd42a3-ab6c-440f-8d03-dc71187e3229 None None] PATH_INFO: `/` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:45:36.099000 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 618/1220] 10.222.0.23 () {54 vars in 921 bytes} [Thu Aug 18 19:45:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:45:36.104913 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b809700-797e-4de7-9b8a-25ec0ae8dccb None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:45:36.105814 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b809700-797e-4de7-9b8a-25ec0ae8dccb None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:45:36.106255 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b809700-797e-4de7-9b8a-25ec0ae8dccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:45:36.134562 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-6b809700-797e-4de7-9b8a-25ec0ae8dccb None None] MFA Rules not processed for user `9c3560e900d248bc93147ddce515365b`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:45:36.135922 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-6b809700-797e-4de7-9b8a-25ec0ae8dccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:45:36.146148 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 603/1221] 10.222.0.23 () {58 vars in 1018 bytes} [Thu Aug 18 19:45:36 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 19:45:36.163970 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afd42a3-ab6c-440f-8d03-dc71187e3229 None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:45:36.178055 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afd42a3-ab6c-440f-8d03-dc71187e3229 None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:45:36.184083 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c051c3-f9cd-4907-b1f7-8572687e10ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c3560e900d248bc93147ddce515365b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a44b197c3aa0479092f4d77d2c791c39', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:45:36.184691 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c051c3-f9cd-4907-b1f7-8572687e10ee service nova] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:45:36.184967 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c051c3-f9cd-4907-b1f7-8572687e10ee service nova] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:45:36.185232 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c051c3-f9cd-4907-b1f7-8572687e10ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:45:36.198255 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c051c3-f9cd-4907-b1f7-8572687e10ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:45:36.200747 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c051c3-f9cd-4907-b1f7-8572687e10ee service nova] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:45:36.211137 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 619/1222] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Aug 18 19:45:36 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:45:42.828122 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c52591-34bb-4eb8-8f99-fa6ece91590d None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:45:42.828743 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c52591-34bb-4eb8-8f99-fa6ece91590d None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:45:42.828743 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c52591-34bb-4eb8-8f99-fa6ece91590d None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:45:42.830220 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 604/1223] 10.222.0.23 () {54 vars in 921 bytes} [Thu Aug 18 19:45:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:45:42.843098 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e649fa3d-bda1-4d52-b585-ad122b6b209d None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:45:42.843661 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e649fa3d-bda1-4d52-b585-ad122b6b209d None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:45:42.843661 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e649fa3d-bda1-4d52-b585-ad122b6b209d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:45:42.863417 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-e649fa3d-bda1-4d52-b585-ad122b6b209d None None] MFA Rules not processed for user `9c3560e900d248bc93147ddce515365b`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:45:42.864617 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-e649fa3d-bda1-4d52-b585-ad122b6b209d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:45:42.874084 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 620/1224] 10.222.0.23 () {58 vars in 1018 bytes} [Thu Aug 18 19:45:42 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:45:42.887909 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c52591-34bb-4eb8-8f99-fa6ece91590d None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:45:42.902259 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c52591-34bb-4eb8-8f99-fa6ece91590d None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:45:42.908892 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f513d71-21f8-4d75-9511-ec4391297d01 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c3560e900d248bc93147ddce515365b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a44b197c3aa0479092f4d77d2c791c39', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:45:42.908892 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f513d71-21f8-4d75-9511-ec4391297d01 service nova] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:45:42.908892 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f513d71-21f8-4d75-9511-ec4391297d01 service nova] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:45:42.908892 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f513d71-21f8-4d75-9511-ec4391297d01 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:45:42.916673 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f513d71-21f8-4d75-9511-ec4391297d01 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:45:42.918246 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f513d71-21f8-4d75-9511-ec4391297d01 service nova] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:45:42.928582 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 605/1225] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Aug 18 19:45:42 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:45:52.858561 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=12 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:45:52.924439 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=15 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:46:01.048198 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e649fa3d-bda1-4d52-b585-ad122b6b209d None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:46:01.058211 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e649fa3d-bda1-4d52-b585-ad122b6b209d None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:46:01.064135 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6624ad-b40d-4563-9856-1d17f419ecbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '516923ce386f459190af3fd7eaa81551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a44b197c3aa0479092f4d77d2c791c39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:46:01.064135 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6624ad-b40d-4563-9856-1d17f419ecbb service neutron] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:46:01.064135 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6624ad-b40d-4563-9856-1d17f419ecbb service neutron] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:46:01.064135 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6624ad-b40d-4563-9856-1d17f419ecbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:46:01.079660 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6624ad-b40d-4563-9856-1d17f419ecbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:46:01.082924 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6624ad-b40d-4563-9856-1d17f419ecbb service neutron] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:46:01.091898 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 621/1226] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Aug 18 19:46:01 2022] GET /identity/v3/auth/tokens => generated 2889 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:46:09.603827 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ff9c44-0be7-43fe-b0c8-3c4266897645 None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:46:09.603827 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ff9c44-0be7-43fe-b0c8-3c4266897645 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:46:09.603827 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ff9c44-0be7-43fe-b0c8-3c4266897645 None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:46:09.603827 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 606/1227] 10.222.0.23 () {54 vars in 921 bytes} [Thu Aug 18 19:46:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:46:09.634499 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14bf5ea-265f-4d1c-a51d-4ab12cc1ab12 None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:46:09.634499 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14bf5ea-265f-4d1c-a51d-4ab12cc1ab12 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:46:09.634499 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14bf5ea-265f-4d1c-a51d-4ab12cc1ab12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:46:09.634499 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-a14bf5ea-265f-4d1c-a51d-4ab12cc1ab12 None None] MFA Rules not processed for user `9c3560e900d248bc93147ddce515365b`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:46:09.634499 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-a14bf5ea-265f-4d1c-a51d-4ab12cc1ab12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:46:09.634499 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 622/1228] 10.222.0.23 () {58 vars in 1018 bytes} [Thu Aug 18 19:46:09 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:46:09.636786 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ff9c44-0be7-43fe-b0c8-3c4266897645 None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:46:09.653767 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ff9c44-0be7-43fe-b0c8-3c4266897645 None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:46:09.666792 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66abac67-8297-4e58-9f48-fe4b0e7bfee4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c3560e900d248bc93147ddce515365b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a44b197c3aa0479092f4d77d2c791c39', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:46:09.668783 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66abac67-8297-4e58-9f48-fe4b0e7bfee4 service nova] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:46:09.668783 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66abac67-8297-4e58-9f48-fe4b0e7bfee4 service nova] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:46:09.669150 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66abac67-8297-4e58-9f48-fe4b0e7bfee4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:46:09.679276 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66abac67-8297-4e58-9f48-fe4b0e7bfee4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:46:09.681246 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66abac67-8297-4e58-9f48-fe4b0e7bfee4 service nova] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:46:09.695054 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 607/1229] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Aug 18 19:46:09 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:46:19.581805 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=9 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:46:19.689894 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=6 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:47:08.309338 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614b0419-1613-4531-939d-4f6267e3fcdf None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:47:08.309830 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614b0419-1613-4531-939d-4f6267e3fcdf None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:47:08.309914 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614b0419-1613-4531-939d-4f6267e3fcdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:47:08.338034 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-614b0419-1613-4531-939d-4f6267e3fcdf None None] MFA Rules not processed for user `30f69f380a2c49258fb1a332bf1e012d`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:47:08.339157 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-614b0419-1613-4531-939d-4f6267e3fcdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:47:08.364515 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 623/1230] 10.222.0.23 () {58 vars in 958 bytes} [Thu Aug 18 19:47:08 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:47:08.691037 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203480d6-ba37-4959-a78c-18ae6783d060 None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:47:08.691534 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203480d6-ba37-4959-a78c-18ae6783d060 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:47:08.691618 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203480d6-ba37-4959-a78c-18ae6783d060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:47:08.736749 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-203480d6-ba37-4959-a78c-18ae6783d060 None None] MFA Rules not processed for user `516923ce386f459190af3fd7eaa81551`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:47:08.738020 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-203480d6-ba37-4959-a78c-18ae6783d060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:47:08.753304 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 608/1231] 10.222.0.23 () {58 vars in 1009 bytes} [Thu Aug 18 19:47:08 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:47:08.764503 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614b0419-1613-4531-939d-4f6267e3fcdf None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:47:08.774272 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614b0419-1613-4531-939d-4f6267e3fcdf None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:47:08.777826 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dcb08c-975f-41c9-a25e-bd4adfa80332 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '516923ce386f459190af3fd7eaa81551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a44b197c3aa0479092f4d77d2c791c39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:47:08.778413 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dcb08c-975f-41c9-a25e-bd4adfa80332 service neutron] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:47:08.778690 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dcb08c-975f-41c9-a25e-bd4adfa80332 service neutron] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:47:08.778967 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dcb08c-975f-41c9-a25e-bd4adfa80332 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:47:08.785778 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dcb08c-975f-41c9-a25e-bd4adfa80332 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:47:08.787202 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dcb08c-975f-41c9-a25e-bd4adfa80332 service neutron] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:47:08.794839 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 624/1232] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Aug 18 19:47:08 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:47:18.750022 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=17 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:47:18.791434 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=21 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:47:47.147410 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b609965f-92ac-416f-9ba6-1735b354845d None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:47:47.147876 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b609965f-92ac-416f-9ba6-1735b354845d None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:47:47.147990 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b609965f-92ac-416f-9ba6-1735b354845d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:47:47.171596 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-b609965f-92ac-416f-9ba6-1735b354845d None None] MFA Rules not processed for user `30f69f380a2c49258fb1a332bf1e012d`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:47:47.172839 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-b609965f-92ac-416f-9ba6-1735b354845d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:47:47.179731 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 609/1233] 10.222.0.23 () {58 vars in 958 bytes} [Thu Aug 18 19:47:47 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:47:57.165744 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=3 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:48:06.919837 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b638adfa-34e0-4256-b8f4-8cc9375987f6 None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:48:06.920306 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b638adfa-34e0-4256-b8f4-8cc9375987f6 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:48:06.920396 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b638adfa-34e0-4256-b8f4-8cc9375987f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:48:06.938788 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-b638adfa-34e0-4256-b8f4-8cc9375987f6 None None] MFA Rules not processed for user `30f69f380a2c49258fb1a332bf1e012d`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:48:06.939968 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-b638adfa-34e0-4256-b8f4-8cc9375987f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:48:06.946680 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 625/1234] 10.222.0.23 () {58 vars in 958 bytes} [Thu Aug 18 19:48:06 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:48:16.934085 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=3 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:48:30.910191 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b609965f-92ac-416f-9ba6-1735b354845d None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:48:30.957818 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b609965f-92ac-416f-9ba6-1735b354845d None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:48:30.963947 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077288bb-8392-4025-8e53-987f049e1ada service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b80a74afafd94acd8703fda561e1e4cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a44b197c3aa0479092f4d77d2c791c39', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:48:30.964554 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077288bb-8392-4025-8e53-987f049e1ada service placement] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:48:30.964832 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077288bb-8392-4025-8e53-987f049e1ada service placement] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:48:30.965104 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077288bb-8392-4025-8e53-987f049e1ada service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:48:30.973883 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077288bb-8392-4025-8e53-987f049e1ada service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:48:30.975470 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077288bb-8392-4025-8e53-987f049e1ada service placement] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:48:30.986448 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 610/1235] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Aug 18 19:48:30 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:48:40.982684 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=19 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:49:29.612575 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307b7289-5d42-45bc-83e0-f83c5537de86 None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:49:29.613066 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307b7289-5d42-45bc-83e0-f83c5537de86 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:49:29.613158 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307b7289-5d42-45bc-83e0-f83c5537de86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:49:29.632255 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-307b7289-5d42-45bc-83e0-f83c5537de86 None None] MFA Rules not processed for user `30f69f380a2c49258fb1a332bf1e012d`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:49:29.633431 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-307b7289-5d42-45bc-83e0-f83c5537de86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:49:29.640076 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 626/1236] 10.222.0.23 () {58 vars in 958 bytes} [Thu Aug 18 19:49:29 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:49:39.626377 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=3 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:49:45.036916 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077288bb-8392-4025-8e53-987f049e1ada service placement] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:49:45.046534 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077288bb-8392-4025-8e53-987f049e1ada service placement] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:49:45.050144 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67b316e-d2e4-4a8f-a02b-7aa5999e7df5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '516923ce386f459190af3fd7eaa81551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a44b197c3aa0479092f4d77d2c791c39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:49:45.055804 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b316e-d2e4-4a8f-a02b-7aa5999e7df5 service neutron] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:49:45.055804 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b316e-d2e4-4a8f-a02b-7aa5999e7df5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:49:45.055804 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b316e-d2e4-4a8f-a02b-7aa5999e7df5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:49:45.060748 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67b316e-d2e4-4a8f-a02b-7aa5999e7df5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:49:45.062229 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67b316e-d2e4-4a8f-a02b-7aa5999e7df5 service neutron] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:49:45.072286 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 611/1237] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Aug 18 19:49:45 2022] GET /identity/v3/auth/tokens => generated 2883 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:49:55.067960 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=6 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:50:29.862094 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307b7289-5d42-45bc-83e0-f83c5537de86 None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:50:29.884458 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307b7289-5d42-45bc-83e0-f83c5537de86 None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:50:29.889484 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a624caa7-0e2d-4b1d-b609-050ceda01820 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c3560e900d248bc93147ddce515365b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a44b197c3aa0479092f4d77d2c791c39', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:50:29.892501 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a624caa7-0e2d-4b1d-b609-050ceda01820 service nova] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:50:29.892501 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a624caa7-0e2d-4b1d-b609-050ceda01820 service nova] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:50:29.892501 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a624caa7-0e2d-4b1d-b609-050ceda01820 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:50:29.898556 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a624caa7-0e2d-4b1d-b609-050ceda01820 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:50:29.900261 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a624caa7-0e2d-4b1d-b609-050ceda01820 service nova] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:50:29.909131 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 627/1238] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Aug 18 19:50:29 2022] GET /identity/v3/auth/tokens => generated 2822 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:50:29.957980 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67b316e-d2e4-4a8f-a02b-7aa5999e7df5 service neutron] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:50:29.966324 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67b316e-d2e4-4a8f-a02b-7aa5999e7df5 service neutron] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:50:29.969894 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8b2f8a-1289-4451-8a7c-2196101c3750 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '516923ce386f459190af3fd7eaa81551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a44b197c3aa0479092f4d77d2c791c39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:50:29.970483 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8b2f8a-1289-4451-8a7c-2196101c3750 service neutron] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:50:29.971012 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8b2f8a-1289-4451-8a7c-2196101c3750 service neutron] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:50:29.971343 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8b2f8a-1289-4451-8a7c-2196101c3750 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:50:29.980764 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8b2f8a-1289-4451-8a7c-2196101c3750 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:50:29.982221 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8b2f8a-1289-4451-8a7c-2196101c3750 service neutron] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:50:29.992110 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 612/1239] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Aug 18 19:50:29 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:50:31.948709 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a624caa7-0e2d-4b1d-b609-050ceda01820 service nova] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:50:32.021437 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a624caa7-0e2d-4b1d-b609-050ceda01820 service nova] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:50:32.026366 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6c47b1-f63f-4a46-948d-218093e02879 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28c99ca9206340269f30be592fcd3f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a44b197c3aa0479092f4d77d2c791c39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:50:32.027013 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6c47b1-f63f-4a46-948d-218093e02879 service cinder] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:50:32.027290 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6c47b1-f63f-4a46-948d-218093e02879 service cinder] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:50:32.027559 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6c47b1-f63f-4a46-948d-218093e02879 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:50:32.038369 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6c47b1-f63f-4a46-948d-218093e02879 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:50:32.040519 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6c47b1-f63f-4a46-948d-218093e02879 service cinder] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:50:32.054428 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 628/1240] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Aug 18 19:50:31 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:50:39.987908 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=6 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:50:42.047135 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=40 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:50:44.618841 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8b2f8a-1289-4451-8a7c-2196101c3750 service neutron] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:50:44.630034 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8b2f8a-1289-4451-8a7c-2196101c3750 service neutron] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:50:44.638156 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd062db-18e8-4989-85b6-25aa537ecc96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c3560e900d248bc93147ddce515365b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a44b197c3aa0479092f4d77d2c791c39', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:50:44.638156 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd062db-18e8-4989-85b6-25aa537ecc96 service nova] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:50:44.638156 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd062db-18e8-4989-85b6-25aa537ecc96 service nova] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:50:44.638156 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd062db-18e8-4989-85b6-25aa537ecc96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:50:44.646702 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd062db-18e8-4989-85b6-25aa537ecc96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:50:44.648286 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd062db-18e8-4989-85b6-25aa537ecc96 service nova] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:50:44.658360 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 613/1241] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Aug 18 19:50:44 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 19:50:54.654215 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=6 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:50:55.633617 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd07a4c9-6cb4-47d9-ac90-d4a76144bb70 None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:50:55.634133 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd07a4c9-6cb4-47d9-ac90-d4a76144bb70 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:50:55.634226 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd07a4c9-6cb4-47d9-ac90-d4a76144bb70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:50:55.654353 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-dd07a4c9-6cb4-47d9-ac90-d4a76144bb70 None None] MFA Rules not processed for user `fffe0e01e05f475784d774e8e3670ce5`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:50:55.655588 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-dd07a4c9-6cb4-47d9-ac90-d4a76144bb70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:50:55.662566 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 629/1242] 10.222.0.23 () {58 vars in 958 bytes} [Thu Aug 18 19:50:55 2022] POST /identity/v3/auth/tokens => generated 2822 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:50:56.298435 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd062db-18e8-4989-85b6-25aa537ecc96 service nova] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:50:56.310379 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd062db-18e8-4989-85b6-25aa537ecc96 service nova] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:50:56.315385 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11f6d56-7f9c-4aac-8fcf-49c2003e7b5f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b80a74afafd94acd8703fda561e1e4cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a44b197c3aa0479092f4d77d2c791c39', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:50:56.316124 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f6d56-7f9c-4aac-8fcf-49c2003e7b5f service placement] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:50:56.316407 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f6d56-7f9c-4aac-8fcf-49c2003e7b5f service placement] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:50:56.316679 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f6d56-7f9c-4aac-8fcf-49c2003e7b5f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:50:56.325697 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11f6d56-7f9c-4aac-8fcf-49c2003e7b5f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:50:56.327276 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11f6d56-7f9c-4aac-8fcf-49c2003e7b5f service placement] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:50:56.337467 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 614/1243] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Aug 18 19:50:56 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:51:05.648292 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=3 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:51:06.333355 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=6 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:51:08.491156 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd07a4c9-6cb4-47d9-ac90-d4a76144bb70 None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:51:08.502592 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd07a4c9-6cb4-47d9-ac90-d4a76144bb70 None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:51:08.506708 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89a4864-6352-4475-865b-6abf7c065403 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '516923ce386f459190af3fd7eaa81551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a44b197c3aa0479092f4d77d2c791c39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:51:08.507444 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a4864-6352-4475-865b-6abf7c065403 service neutron] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:51:08.507750 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a4864-6352-4475-865b-6abf7c065403 service neutron] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:51:08.508024 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a4864-6352-4475-865b-6abf7c065403 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:51:08.516279 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89a4864-6352-4475-865b-6abf7c065403 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:51:08.517730 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89a4864-6352-4475-865b-6abf7c065403 service neutron] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:51:08.526289 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 630/1244] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Aug 18 19:51:08 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:51:16.367328 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11f6d56-7f9c-4aac-8fcf-49c2003e7b5f service placement] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:51:16.378918 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11f6d56-7f9c-4aac-8fcf-49c2003e7b5f service placement] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:51:16.385062 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183bf6e4-4ba5-495d-aa73-19b822ba1e82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c3560e900d248bc93147ddce515365b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a44b197c3aa0479092f4d77d2c791c39', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:51:16.385062 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183bf6e4-4ba5-495d-aa73-19b822ba1e82 service nova] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:51:16.385062 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183bf6e4-4ba5-495d-aa73-19b822ba1e82 service nova] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:51:16.385062 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183bf6e4-4ba5-495d-aa73-19b822ba1e82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:51:16.393905 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183bf6e4-4ba5-495d-aa73-19b822ba1e82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:51:16.395475 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183bf6e4-4ba5-495d-aa73-19b822ba1e82 service nova] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:51:16.405324 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 615/1245] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Aug 18 19:51:16 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:51:18.522811 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=6 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:51:26.401075 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=6 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:51:27.631184 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89a4864-6352-4475-865b-6abf7c065403 service neutron] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:51:27.639767 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89a4864-6352-4475-865b-6abf7c065403 service neutron] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:51:27.643857 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef858c2a-fa20-4514-bad9-d299f3830f32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '516923ce386f459190af3fd7eaa81551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a44b197c3aa0479092f4d77d2c791c39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:51:27.644448 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef858c2a-fa20-4514-bad9-d299f3830f32 service neutron] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:51:27.644726 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef858c2a-fa20-4514-bad9-d299f3830f32 service neutron] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:51:27.645001 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef858c2a-fa20-4514-bad9-d299f3830f32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:51:27.654045 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef858c2a-fa20-4514-bad9-d299f3830f32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:51:27.655519 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef858c2a-fa20-4514-bad9-d299f3830f32 service neutron] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:51:27.665316 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 631/1246] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Aug 18 19:51:27 2022] GET /identity/v3/auth/tokens => generated 2889 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:51:29.921422 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183bf6e4-4ba5-495d-aa73-19b822ba1e82 service nova] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:51:29.933089 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183bf6e4-4ba5-495d-aa73-19b822ba1e82 service nova] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:51:29.939007 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c711200d-b3ee-4d91-988a-f1de5b20962c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c3560e900d248bc93147ddce515365b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a44b197c3aa0479092f4d77d2c791c39', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:51:29.940295 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c711200d-b3ee-4d91-988a-f1de5b20962c service nova] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:51:29.940570 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c711200d-b3ee-4d91-988a-f1de5b20962c service nova] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:51:29.940839 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c711200d-b3ee-4d91-988a-f1de5b20962c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:51:29.949959 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c711200d-b3ee-4d91-988a-f1de5b20962c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:51:29.951540 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c711200d-b3ee-4d91-988a-f1de5b20962c service nova] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:51:29.961818 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 616/1247] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Aug 18 19:51:29 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:51:37.661220 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=6 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:51:39.958011 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=6 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:53:11.893887 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef858c2a-fa20-4514-bad9-d299f3830f32 service neutron] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:53:11.905248 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef858c2a-fa20-4514-bad9-d299f3830f32 service neutron] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:53:11.910170 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f415f3-501a-4834-954c-ea600e71611d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c3560e900d248bc93147ddce515365b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a44b197c3aa0479092f4d77d2c791c39', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:53:11.910754 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f415f3-501a-4834-954c-ea600e71611d service nova] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:53:11.911034 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f415f3-501a-4834-954c-ea600e71611d service nova] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:53:11.911305 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f415f3-501a-4834-954c-ea600e71611d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:53:11.919484 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f415f3-501a-4834-954c-ea600e71611d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:53:11.927113 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f415f3-501a-4834-954c-ea600e71611d service nova] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:53:11.929573 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 632/1248] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Aug 18 19:53:11 2022] GET /identity/v3/auth/tokens => generated 2814 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:53:21.925801 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=6 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:53:26.027406 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c711200d-b3ee-4d91-988a-f1de5b20962c service nova] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:53:26.036654 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c711200d-b3ee-4d91-988a-f1de5b20962c service nova] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:53:26.040267 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6b5240-4b71-46ca-845a-4cd18a7c439c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '516923ce386f459190af3fd7eaa81551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a44b197c3aa0479092f4d77d2c791c39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:53:26.040853 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b5240-4b71-46ca-845a-4cd18a7c439c service neutron] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:53:26.041127 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b5240-4b71-46ca-845a-4cd18a7c439c service neutron] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:53:26.041402 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b5240-4b71-46ca-845a-4cd18a7c439c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:53:26.111627 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6b5240-4b71-46ca-845a-4cd18a7c439c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:53:26.113046 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6b5240-4b71-46ca-845a-4cd18a7c439c service neutron] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:53:26.131234 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 617/1249] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Aug 18 19:53:26 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:53:29.719559 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a04532-d6e8-49b2-81c4-d42259b75979 None None] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:53:29.720056 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a04532-d6e8-49b2-81c4-d42259b75979 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:53:29.720275 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a04532-d6e8-49b2-81c4-d42259b75979 None None] PATH_INFO: `/` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:53:29.721884 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 633/1250] 10.222.0.23 () {54 vars in 921 bytes} [Thu Aug 18 19:53:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:53:29.747018 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc775af-48c7-44f6-859a-a4b66ba1d253 None None] REQUEST_METHOD: `POST` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:53:29.748396 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc775af-48c7-44f6-859a-a4b66ba1d253 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:53:29.748396 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc775af-48c7-44f6-859a-a4b66ba1d253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:53:29.808464 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.auth.core [None req-ecc775af-48c7-44f6-859a-a4b66ba1d253 None None] MFA Rules not processed for user `b80a74afafd94acd8703fda561e1e4cd`. Rule list: `[]` (Enabled: `True`). {{(pid=88471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:53:29.809709 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-ecc775af-48c7-44f6-859a-a4b66ba1d253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:53:29.818728 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 618/1251] 10.222.0.23 () {58 vars in 1018 bytes} [Thu Aug 18 19:53:29 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 19:53:29.830169 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a04532-d6e8-49b2-81c4-d42259b75979 None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:53:29.831928 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-32a04532-d6e8-49b2-81c4-d42259b75979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:53:29.848475 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a04532-d6e8-49b2-81c4-d42259b75979 None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:53:29.853644 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cf8980-ff5d-4ddf-8122-c8957400bb6d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b80a74afafd94acd8703fda561e1e4cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a44b197c3aa0479092f4d77d2c791c39', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:53:29.854282 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf8980-ff5d-4ddf-8122-c8957400bb6d service placement] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:53:29.854593 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf8980-ff5d-4ddf-8122-c8957400bb6d service placement] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:53:29.855254 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf8980-ff5d-4ddf-8122-c8957400bb6d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:53:29.863599 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cf8980-ff5d-4ddf-8122-c8957400bb6d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:53:29.866686 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cf8980-ff5d-4ddf-8122-c8957400bb6d service placement] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:53:29.889840 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 634/1252] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Aug 18 19:53:29 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:53:33.555056 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc775af-48c7-44f6-859a-a4b66ba1d253 None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:53:33.567681 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc775af-48c7-44f6-859a-a4b66ba1d253 None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:53:33.572919 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5860c1fb-2f8d-4cb4-8bae-9a253edd9f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df56ebe1a05047a7a4d05174a8a4c7f1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:53:33.574831 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5860c1fb-2f8d-4cb4-8bae-9a253edd9f56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:53:33.574831 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5860c1fb-2f8d-4cb4-8bae-9a253edd9f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:53:33.575030 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5860c1fb-2f8d-4cb4-8bae-9a253edd9f56 admin admin] PATH_INFO: `/v3/users/30f69f380a2c49258fb1a332bf1e012d` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:53:33.576384 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5860c1fb-2f8d-4cb4-8bae-9a253edd9f56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30f69f380a2c49258fb1a332bf1e012d)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:53:33.577437 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: WARNING py.warnings [None req-5860c1fb-2f8d-4cb4-8bae-9a253edd9f56 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 19:53:33.577437 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: warnings.warn(msg) Aug 18 19:53:33.577437 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: Aug 18 19:53:33.578776 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5860c1fb-2f8d-4cb4-8bae-9a253edd9f56 admin admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:53:33.793576 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.notifications [None req-5860c1fb-2f8d-4cb4-8bae-9a253edd9f56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30f69f380a2c49258fb1a332bf1e012d'} {{(pid=88471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 19:53:33.813621 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.notifications [None req-5860c1fb-2f8d-4cb4-8bae-9a253edd9f56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30f69f380a2c49258fb1a332bf1e012d'} {{(pid=88471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 19:53:33.891184 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.notifications [None req-5860c1fb-2f8d-4cb4-8bae-9a253edd9f56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30f69f380a2c49258fb1a332bf1e012d'} {{(pid=88471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 19:53:33.902015 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.notifications [None req-5860c1fb-2f8d-4cb4-8bae-9a253edd9f56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30f69f380a2c49258fb1a332bf1e012d'} {{(pid=88471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 19:53:33.902666 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.notifications [None req-5860c1fb-2f8d-4cb4-8bae-9a253edd9f56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30f69f380a2c49258fb1a332bf1e012d'} {{(pid=88471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 19:53:33.908822 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 619/1253] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Aug 18 19:53:33 2022] DELETE /identity/v3/users/30f69f380a2c49258fb1a332bf1e012d => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 19:53:34.413818 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cf8980-ff5d-4ddf-8122-c8957400bb6d service placement] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:53:34.425210 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cf8980-ff5d-4ddf-8122-c8957400bb6d service placement] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:53:34.483494 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa8552e-8a19-416c-8313-df3ca9abf0d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df56ebe1a05047a7a4d05174a8a4c7f1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:53:34.484122 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa8552e-8a19-416c-8313-df3ca9abf0d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:53:34.484403 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa8552e-8a19-416c-8313-df3ca9abf0d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:53:34.484681 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa8552e-8a19-416c-8313-df3ca9abf0d8 admin admin] PATH_INFO: `/v3/projects/33ba909822bf464794b58d89598a9ffb` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:53:34.485830 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa8552e-8a19-416c-8313-df3ca9abf0d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33ba909822bf464794b58d89598a9ffb)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:53:34.486849 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: WARNING py.warnings [None req-efa8552e-8a19-416c-8313-df3ca9abf0d8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 19:53:34.486849 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: warnings.warn(msg) Aug 18 19:53:34.486849 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: Aug 18 19:53:34.488041 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa8552e-8a19-416c-8313-df3ca9abf0d8 admin admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:53:34.614026 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.notifications [None req-efa8552e-8a19-416c-8313-df3ca9abf0d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33ba909822bf464794b58d89598a9ffb', 'request_id': 'req-efa8552e-8a19-416c-8313-df3ca9abf0d8'} {{(pid=88470) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 19:53:34.732188 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.notifications [None req-efa8552e-8a19-416c-8313-df3ca9abf0d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33ba909822bf464794b58d89598a9ffb', 'request_id': 'req-efa8552e-8a19-416c-8313-df3ca9abf0d8'} {{(pid=88470) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 19:53:34.745919 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.notifications [None req-efa8552e-8a19-416c-8313-df3ca9abf0d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33ba909822bf464794b58d89598a9ffb', 'request_id': 'req-efa8552e-8a19-416c-8313-df3ca9abf0d8'} {{(pid=88470) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 19:53:34.768845 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.notifications [None req-efa8552e-8a19-416c-8313-df3ca9abf0d8 admin admin] The token cache is being invalidate because project 33ba909822bf464794b58d89598a9ffb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88470) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 19:53:34.769131 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.notifications [None req-efa8552e-8a19-416c-8313-df3ca9abf0d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88470) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 19:53:34.769779 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.notifications [None req-efa8552e-8a19-416c-8313-df3ca9abf0d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88470) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 19:53:34.771272 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 635/1254] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 18 19:53:34 2022] DELETE /identity/v3/projects/33ba909822bf464794b58d89598a9ffb => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 19:53:34.775371 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5860c1fb-2f8d-4cb4-8bae-9a253edd9f56 admin admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:53:34.777755 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-5860c1fb-2f8d-4cb4-8bae-9a253edd9f56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:53:34.791309 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5860c1fb-2f8d-4cb4-8bae-9a253edd9f56 admin admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:53:34.796113 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:53:34.847402 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979996d3-bb10-4422-a91f-d57823be773f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df56ebe1a05047a7a4d05174a8a4c7f1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:53:34.848027 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979996d3-bb10-4422-a91f-d57823be773f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:53:34.848316 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979996d3-bb10-4422-a91f-d57823be773f admin admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:53:34.848869 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979996d3-bb10-4422-a91f-d57823be773f admin admin] PATH_INFO: `/v3/users/49262c48a1c74ae6b5bfc239ab5b42b9` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:53:34.850006 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979996d3-bb10-4422-a91f-d57823be773f admin admin] RBAC: Authorizing `identity:delete_user(user_id=49262c48a1c74ae6b5bfc239ab5b42b9)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:53:34.851962 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979996d3-bb10-4422-a91f-d57823be773f admin admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:53:35.060023 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.notifications [None req-979996d3-bb10-4422-a91f-d57823be773f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49262c48a1c74ae6b5bfc239ab5b42b9'} {{(pid=88471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 19:53:35.071946 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.notifications [None req-979996d3-bb10-4422-a91f-d57823be773f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49262c48a1c74ae6b5bfc239ab5b42b9'} {{(pid=88471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 19:53:35.132021 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.notifications [None req-979996d3-bb10-4422-a91f-d57823be773f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49262c48a1c74ae6b5bfc239ab5b42b9'} {{(pid=88471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 19:53:35.139703 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.notifications [None req-979996d3-bb10-4422-a91f-d57823be773f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49262c48a1c74ae6b5bfc239ab5b42b9'} {{(pid=88471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 19:53:35.140374 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.notifications [None req-979996d3-bb10-4422-a91f-d57823be773f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49262c48a1c74ae6b5bfc239ab5b42b9'} {{(pid=88471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 19:53:35.146162 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 620/1255] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Aug 18 19:53:34 2022] DELETE /identity/v3/users/49262c48a1c74ae6b5bfc239ab5b42b9 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 19:53:35.391274 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa8552e-8a19-416c-8313-df3ca9abf0d8 admin admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:53:35.392757 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-efa8552e-8a19-416c-8313-df3ca9abf0d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:53:35.407765 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa8552e-8a19-416c-8313-df3ca9abf0d8 admin admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:53:35.465203 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1990585f-d5c7-4452-93a3-594adc32320d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df56ebe1a05047a7a4d05174a8a4c7f1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:53:35.465897 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990585f-d5c7-4452-93a3-594adc32320d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:53:35.466153 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990585f-d5c7-4452-93a3-594adc32320d admin admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:53:35.466407 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990585f-d5c7-4452-93a3-594adc32320d admin admin] PATH_INFO: `/v3/projects/95649e24365742d6aa91be9275aca754` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:53:35.467520 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1990585f-d5c7-4452-93a3-594adc32320d admin admin] RBAC: Authorizing `identity:delete_project(project_id=95649e24365742d6aa91be9275aca754)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:53:35.469419 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1990585f-d5c7-4452-93a3-594adc32320d admin admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:53:35.477376 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:53:35.560783 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.notifications [None req-1990585f-d5c7-4452-93a3-594adc32320d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95649e24365742d6aa91be9275aca754', 'request_id': 'req-1990585f-d5c7-4452-93a3-594adc32320d'} {{(pid=88470) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 19:53:35.617878 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.notifications [None req-1990585f-d5c7-4452-93a3-594adc32320d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95649e24365742d6aa91be9275aca754', 'request_id': 'req-1990585f-d5c7-4452-93a3-594adc32320d'} {{(pid=88470) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 19:53:35.625344 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.notifications [None req-1990585f-d5c7-4452-93a3-594adc32320d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95649e24365742d6aa91be9275aca754', 'request_id': 'req-1990585f-d5c7-4452-93a3-594adc32320d'} {{(pid=88470) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 19:53:35.636052 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.notifications [None req-1990585f-d5c7-4452-93a3-594adc32320d admin admin] The token cache is being invalidate because project 95649e24365742d6aa91be9275aca754 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88470) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 19:53:35.636279 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.notifications [None req-1990585f-d5c7-4452-93a3-594adc32320d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88470) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 19:53:35.636924 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.notifications [None req-1990585f-d5c7-4452-93a3-594adc32320d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88470) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 19:53:35.638444 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 636/1256] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 18 19:53:35 2022] DELETE /identity/v3/projects/95649e24365742d6aa91be9275aca754 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 19:53:45.155337 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=49,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:53:45.633119 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=21,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:53:57.381307 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979996d3-bb10-4422-a91f-d57823be773f admin admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:53:57.382893 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-979996d3-bb10-4422-a91f-d57823be773f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:53:57.452136 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979996d3-bb10-4422-a91f-d57823be773f admin admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:53:57.510116 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f127cdbd-4865-47af-afca-1640b8fe73de service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b80a74afafd94acd8703fda561e1e4cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a44b197c3aa0479092f4d77d2c791c39', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:53:57.510634 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f127cdbd-4865-47af-afca-1640b8fe73de service placement] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:53:57.510914 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f127cdbd-4865-47af-afca-1640b8fe73de service placement] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:53:57.511193 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f127cdbd-4865-47af-afca-1640b8fe73de service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:53:57.512941 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-f127cdbd-4865-47af-afca-1640b8fe73de service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:53:57.523621 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f127cdbd-4865-47af-afca-1640b8fe73de service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:53:57.525203 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f127cdbd-4865-47af-afca-1640b8fe73de service placement] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:53:57.535183 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 621/1257] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Aug 18 19:53:57 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:53:59.510202 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1990585f-d5c7-4452-93a3-594adc32320d admin admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:53:59.512146 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-1990585f-d5c7-4452-93a3-594adc32320d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:53:59.582263 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1990585f-d5c7-4452-93a3-594adc32320d admin admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:53:59.586022 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0f63c8-b835-453a-9b0b-e2fd04a28c8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '516923ce386f459190af3fd7eaa81551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a44b197c3aa0479092f4d77d2c791c39', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:53:59.586600 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0f63c8-b835-453a-9b0b-e2fd04a28c8f service neutron] REQUEST_METHOD: `GET` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:53:59.586877 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0f63c8-b835-453a-9b0b-e2fd04a28c8f service neutron] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:53:59.587147 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0f63c8-b835-453a-9b0b-e2fd04a28c8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:53:59.589012 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-1e0f63c8-b835-453a-9b0b-e2fd04a28c8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:53:59.652562 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0f63c8-b835-453a-9b0b-e2fd04a28c8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:53:59.654080 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0f63c8-b835-453a-9b0b-e2fd04a28c8f service neutron] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:53:59.665877 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 637/1258] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Aug 18 19:53:59 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:54:03.180291 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dba585-711f-4e3a-9607-ad83e3f28778 None None] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:54:03.180773 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dba585-711f-4e3a-9607-ad83e3f28778 None None] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:54:03.180863 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dba585-711f-4e3a-9607-ad83e3f28778 None None] PATH_INFO: `/` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:54:03.182385 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 622/1259] 10.222.0.23 () {54 vars in 921 bytes} [Thu Aug 18 19:54:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 19:54:03.215092 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3287a0bf-8646-4014-8b1b-d396c0fd0b11 None None] REQUEST_METHOD: `POST` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:54:03.215549 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3287a0bf-8646-4014-8b1b-d396c0fd0b11 None None] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:54:03.215832 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3287a0bf-8646-4014-8b1b-d396c0fd0b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:54:03.235751 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.auth.core [None req-3287a0bf-8646-4014-8b1b-d396c0fd0b11 None None] MFA Rules not processed for user `b80a74afafd94acd8703fda561e1e4cd`. Rule list: `[]` (Enabled: `True`). {{(pid=88470) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 19:54:03.236965 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-3287a0bf-8646-4014-8b1b-d396c0fd0b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:54:03.245454 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 638/1260] 10.222.0.23 () {58 vars in 1018 bytes} [Thu Aug 18 19:54:03 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 19:54:03.256629 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dba585-711f-4e3a-9607-ad83e3f28778 None None] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:54:03.257730 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-d0dba585-711f-4e3a-9607-ad83e3f28778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:54:03.274661 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dba585-711f-4e3a-9607-ad83e3f28778 None None] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:54:03.281022 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3b3b35-61b7-43ea-a6bd-8586efb644d5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b80a74afafd94acd8703fda561e1e4cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a44b197c3aa0479092f4d77d2c791c39', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:54:03.281630 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3b3b35-61b7-43ea-a6bd-8586efb644d5 service placement] REQUEST_METHOD: `GET` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:54:03.281945 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3b3b35-61b7-43ea-a6bd-8586efb644d5 service placement] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:54:03.282222 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3b3b35-61b7-43ea-a6bd-8586efb644d5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:54:03.290589 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3b3b35-61b7-43ea-a6bd-8586efb644d5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:54:03.292162 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3b3b35-61b7-43ea-a6bd-8586efb644d5 service placement] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:54:03.301667 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 623/1261] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Aug 18 19:54:03 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 19:54:06.737894 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3287a0bf-8646-4014-8b1b-d396c0fd0b11 None None] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:54:06.739334 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-3287a0bf-8646-4014-8b1b-d396c0fd0b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:54:06.752702 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3287a0bf-8646-4014-8b1b-d396c0fd0b11 None None] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:54:06.757470 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3772df2-c9c7-494f-b9a3-ce08b92d4bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df56ebe1a05047a7a4d05174a8a4c7f1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:54:06.758134 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3772df2-c9c7-494f-b9a3-ce08b92d4bda admin admin] REQUEST_METHOD: `DELETE` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:54:06.758413 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3772df2-c9c7-494f-b9a3-ce08b92d4bda admin admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:54:06.758685 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3772df2-c9c7-494f-b9a3-ce08b92d4bda admin admin] PATH_INFO: `/v3/users/fffe0e01e05f475784d774e8e3670ce5` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:54:06.759804 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3772df2-c9c7-494f-b9a3-ce08b92d4bda admin admin] RBAC: Authorizing `identity:delete_user(user_id=fffe0e01e05f475784d774e8e3670ce5)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:54:06.762289 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3772df2-c9c7-494f-b9a3-ce08b92d4bda admin admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:54:06.940387 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.notifications [None req-a3772df2-c9c7-494f-b9a3-ce08b92d4bda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fffe0e01e05f475784d774e8e3670ce5'} {{(pid=88470) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 19:54:07.006833 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.notifications [None req-a3772df2-c9c7-494f-b9a3-ce08b92d4bda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fffe0e01e05f475784d774e8e3670ce5'} {{(pid=88470) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 19:54:07.020129 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.notifications [None req-a3772df2-c9c7-494f-b9a3-ce08b92d4bda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fffe0e01e05f475784d774e8e3670ce5'} {{(pid=88470) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 19:54:07.020842 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.notifications [None req-a3772df2-c9c7-494f-b9a3-ce08b92d4bda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fffe0e01e05f475784d774e8e3670ce5'} {{(pid=88470) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 19:54:07.028465 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.notifications [None req-a3772df2-c9c7-494f-b9a3-ce08b92d4bda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fffe0e01e05f475784d774e8e3670ce5'} {{(pid=88470) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 19:54:07.034285 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 639/1262] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Aug 18 19:54:06 2022] DELETE /identity/v3/users/fffe0e01e05f475784d774e8e3670ce5 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 19:54:07.319623 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3b3b35-61b7-43ea-a6bd-8586efb644d5 service placement] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:54:07.330878 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3b3b35-61b7-43ea-a6bd-8586efb644d5 service placement] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:54:07.396973 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe12607-6f9b-4cf2-a58f-f1ca0b50a2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df56ebe1a05047a7a4d05174a8a4c7f1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:54:07.397610 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe12607-6f9b-4cf2-a58f-f1ca0b50a2fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:54:07.397924 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe12607-6f9b-4cf2-a58f-f1ca0b50a2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:54:07.398197 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe12607-6f9b-4cf2-a58f-f1ca0b50a2fa admin admin] PATH_INFO: `/v3/projects/20868e2c86564c6eb7fca9b1d6cb32e7` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:54:07.399303 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe12607-6f9b-4cf2-a58f-f1ca0b50a2fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=20868e2c86564c6eb7fca9b1d6cb32e7)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:54:07.401328 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe12607-6f9b-4cf2-a58f-f1ca0b50a2fa admin admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:54:07.423787 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:SELECT=100 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:54:07.532393 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.notifications [None req-9fe12607-6f9b-4cf2-a58f-f1ca0b50a2fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20868e2c86564c6eb7fca9b1d6cb32e7', 'request_id': 'req-9fe12607-6f9b-4cf2-a58f-f1ca0b50a2fa'} {{(pid=88471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 19:54:07.601285 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.notifications [None req-9fe12607-6f9b-4cf2-a58f-f1ca0b50a2fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20868e2c86564c6eb7fca9b1d6cb32e7', 'request_id': 'req-9fe12607-6f9b-4cf2-a58f-f1ca0b50a2fa'} {{(pid=88471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 19:54:07.607782 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.notifications [None req-9fe12607-6f9b-4cf2-a58f-f1ca0b50a2fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20868e2c86564c6eb7fca9b1d6cb32e7', 'request_id': 'req-9fe12607-6f9b-4cf2-a58f-f1ca0b50a2fa'} {{(pid=88471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 19:54:07.618810 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.notifications [None req-9fe12607-6f9b-4cf2-a58f-f1ca0b50a2fa admin admin] The token cache is being invalidate because project 20868e2c86564c6eb7fca9b1d6cb32e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88471) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 19:54:07.619101 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.notifications [None req-9fe12607-6f9b-4cf2-a58f-f1ca0b50a2fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 19:54:07.619733 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.notifications [None req-9fe12607-6f9b-4cf2-a58f-f1ca0b50a2fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 19:54:07.621246 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 624/1263] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 18 19:54:07 2022] DELETE /identity/v3/projects/20868e2c86564c6eb7fca9b1d6cb32e7 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 19:54:07.625950 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3772df2-c9c7-494f-b9a3-ce08b92d4bda admin admin] Authenticating user token {{(pid=88470) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:54:07.627383 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.fernet_utils [None req-a3772df2-c9c7-494f-b9a3-ce08b92d4bda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88470) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:54:07.636463 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:54:07.640061 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3772df2-c9c7-494f-b9a3-ce08b92d4bda admin admin] Validating token access rules against request {{(pid=88470) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:54:07.696296 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822f5e59-5e09-4057-866e-df170d398638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df56ebe1a05047a7a4d05174a8a4c7f1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88470) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:54:07.696981 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f5e59-5e09-4057-866e-df170d398638 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:54:07.697260 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f5e59-5e09-4057-866e-df170d398638 admin admin] SCRIPT_NAME: `/identity` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:54:07.697537 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f5e59-5e09-4057-866e-df170d398638 admin admin] PATH_INFO: `/v3/users/a44ce3e03c6b4e61a7093ce498bdfa32` {{(pid=88470) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:54:07.698757 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822f5e59-5e09-4057-866e-df170d398638 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a44ce3e03c6b4e61a7093ce498bdfa32)` {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:54:07.700693 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822f5e59-5e09-4057-866e-df170d398638 admin admin] RBAC: Authorization granted {{(pid=88470) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:54:07.831129 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.notifications [None req-822f5e59-5e09-4057-866e-df170d398638 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a44ce3e03c6b4e61a7093ce498bdfa32'} {{(pid=88470) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 19:54:07.886854 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.notifications [None req-822f5e59-5e09-4057-866e-df170d398638 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a44ce3e03c6b4e61a7093ce498bdfa32'} {{(pid=88470) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 19:54:07.898640 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.notifications [None req-822f5e59-5e09-4057-866e-df170d398638 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a44ce3e03c6b4e61a7093ce498bdfa32'} {{(pid=88470) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 19:54:07.903983 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.notifications [None req-822f5e59-5e09-4057-866e-df170d398638 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a44ce3e03c6b4e61a7093ce498bdfa32'} {{(pid=88470) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 19:54:07.906849 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG keystone.notifications [None req-822f5e59-5e09-4057-866e-df170d398638 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a44ce3e03c6b4e61a7093ce498bdfa32'} {{(pid=88470) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 19:54:07.912707 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: [pid: 88470|app: 0|req: 640/1264] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Aug 18 19:54:07 2022] DELETE /identity/v3/users/a44ce3e03c6b4e61a7093ce498bdfa32 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 19:54:08.133865 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe12607-6f9b-4cf2-a58f-f1ca0b50a2fa admin admin] Authenticating user token {{(pid=88471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 19:54:08.138974 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.fernet_utils [None req-9fe12607-6f9b-4cf2-a58f-f1ca0b50a2fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 19:54:08.150991 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe12607-6f9b-4cf2-a58f-f1ca0b50a2fa admin admin] Validating token access rules against request {{(pid=88471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 19:54:08.208645 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb3d0fe-7d84-43e8-94fa-802f3c627667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ddb0f75b40179001f4a64546ab53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df56ebe1a05047a7a4d05174a8a4c7f1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 19:54:08.209315 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb3d0fe-7d84-43e8-94fa-802f3c627667 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 19:54:08.209590 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb3d0fe-7d84-43e8-94fa-802f3c627667 admin admin] SCRIPT_NAME: `/identity` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 19:54:08.209903 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb3d0fe-7d84-43e8-94fa-802f3c627667 admin admin] PATH_INFO: `/v3/projects/4dcd61cf33fe45119cfc78a22b42a794` {{(pid=88471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 19:54:08.211092 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb3d0fe-7d84-43e8-94fa-802f3c627667 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4dcd61cf33fe45119cfc78a22b42a794)` {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 19:54:08.213078 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb3d0fe-7d84-43e8-94fa-802f3c627667 admin admin] RBAC: Authorization granted {{(pid=88471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 19:54:08.339785 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.notifications [None req-7eb3d0fe-7d84-43e8-94fa-802f3c627667 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4dcd61cf33fe45119cfc78a22b42a794', 'request_id': 'req-7eb3d0fe-7d84-43e8-94fa-802f3c627667'} {{(pid=88471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 19:54:08.400844 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.notifications [None req-7eb3d0fe-7d84-43e8-94fa-802f3c627667 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4dcd61cf33fe45119cfc78a22b42a794', 'request_id': 'req-7eb3d0fe-7d84-43e8-94fa-802f3c627667'} {{(pid=88471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 19:54:08.407210 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.notifications [None req-7eb3d0fe-7d84-43e8-94fa-802f3c627667 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4dcd61cf33fe45119cfc78a22b42a794', 'request_id': 'req-7eb3d0fe-7d84-43e8-94fa-802f3c627667'} {{(pid=88471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 19:54:08.418830 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.notifications [None req-7eb3d0fe-7d84-43e8-94fa-802f3c627667 admin admin] The token cache is being invalidate because project 4dcd61cf33fe45119cfc78a22b42a794 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88471) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 19:54:08.419115 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.notifications [None req-7eb3d0fe-7d84-43e8-94fa-802f3c627667 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 19:54:08.419744 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG keystone.notifications [None req-7eb3d0fe-7d84-43e8-94fa-802f3c627667 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 19:54:08.421216 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: [pid: 88471|app: 0|req: 625/1265] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 18 19:54:08 2022] DELETE /identity/v3/projects/4dcd61cf33fe45119cfc78a22b42a794 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 19:54:17.909223 dv-osbrick-786732-13-ceph devstack@keystone.service[88470]: DEBUG dbcounter [-] [88470] Writing DB stats keystone:SELECT=51,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 19:54:18.415796 dv-osbrick-786732-13-ceph devstack@keystone.service[88471]: DEBUG dbcounter [-] [88471] Writing DB stats keystone:DELETE=14,keystone:SELECT=66,keystone:INSERT=2 {{(pid=88471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}